00000100:00100000:3.0F:1762166755.603636:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446774400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166755.603704:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1762166755.603772:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446774400 00000100:00100000:2.0:1762166755.603793:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446774400 00000100:00100000:2.0:1762166755.603881:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1762166755.603895:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446774400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1762166755.603940:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1762166755.604037:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446774400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166755.604047:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1762166755.604081:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446774400:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0F:1762166756.114643:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166756.200658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.200712:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439975296 00000100:00100000:1.0:1762166756.200723:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439975296 00000100:00080000:2.0:1762166756.200772:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166756.200791:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2460 00000100:00100000:1.0:1762166756.200802:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:37500:x1847765439975296:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1762166756.200833:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.200856:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9be lrc: 2/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7520 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.200917:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.200931:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.200941:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.200955:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.200962:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.200969:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201056:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a9d3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201075:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201084:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.201135:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0xf:0x0]: returning size 1048577 00000004:00200000:1.0:1762166756.201140:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.201174:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201187:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201198:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201205:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201212:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201219:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201226:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.201231:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201238:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201251:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166756.201254:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.201259:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201265:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9c5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201283:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201289:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201295:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201300:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.201303:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201309:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201317:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945cc9b89f00) 00010000:00010000:1.0:1762166756.201319:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.201322:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 2/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201327:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.201361:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9be lrc: 0/0,0 mode: --/CR res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7520 expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.201374:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7520 expref: 13 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.201382:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89b00) 00010000:00010000:1.0:1762166756.201389:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166756.201392:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b200, rc 0) 00000100:00100000:1.0:1762166756.201452:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37500:x1847765439975296:12345-192.168.204.38@tcp:101:rm.0 Request processed in 651us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.201461:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2460 00000100:00100000:3.0:1762166756.203366:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.203440:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439975424 00000100:00100000:2.0:1762166756.203450:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439975424 00000100:00080000:1.0:1762166756.203528:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166756.203541:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 873 00000100:00100000:2.0:1762166756.203554:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765439975424:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166756.203567:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166756.203583:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7527 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166756.203606:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166756.203622:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.203625:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.203634:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 8 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.203649:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 8 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.203661:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9f200, rc 0) 00000100:00100000:2.0:1762166756.203708:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765439975424:12345-192.168.204.38@tcp:101:rm.0 Request processed in 157us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.203724:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 873 00000100:00100000:2.0:1762166756.209090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.209149:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439975680 00000100:00100000:1.0:1762166756.209159:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439975680 00000100:00100000:1.0:1762166756.209214:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2461 00000100:00100000:1.0:1762166756.209226:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37500:x1847765439975680:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:1.0:1762166756.209274:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166756.209300:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0a9d3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7520 expref: 13 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.209322:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0a9b0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7519 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.209335:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89b00) 00010000:00010000:1.0:1762166756.209347:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.209366:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209378:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209388:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209400:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209419:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209427:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209531:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209539:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209547:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:1.0:1762166756.209790:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].94, 64 off15840 00000004:00080000:1.0:1762166756.209802:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375358323995ns, next at 376358321105ns, rc = 0 00000040:00080000:1.0:1762166756.209830:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].98, 64 off16168 00000004:00080000:1.0:1762166756.209838:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375358359980ns, next at 376358357885ns, rc = 0 00000040:00080000:1.0:1762166756.209853:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].95, 64 off15904 00000040:00080000:1.0:1762166756.209867:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].99, 64 off16232 00010000:00010000:1.0:1762166756.209925:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209934:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209941:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209947:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209966:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209972:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.209994:0:7432:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166756.210028:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0F:1762166756.210028:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166756.210036:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.210043:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210045:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.210058:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166756.210060:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166756.210064:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210066:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.210080:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210081:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210110:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89700) 00010000:00010000:1.0:1762166756.210114:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762166756.210118:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xf:0x0].0x0 (ffff945cc9b89700) 00010000:00010000:1.0:1762166756.210119:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 2/0,0 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.210125:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166756.210131:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0a9ef lrc: 0/0,0 mode: --/EX res: [0x200000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.210131:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 1/0,0 mode: --/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.210146:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0a9f6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.210164:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166756.210167:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166756.210169:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166756.210315:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210333:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210339:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210345:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210350:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.210353:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210358:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210367:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166756.210369:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.210372:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 3/0,0 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210378:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0a9e1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166756.210387:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000248be767 reply state 0000000006c281f3 transno 4294968797 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210397:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.210402:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945cc9b89f00) 00010000:00010000:1.0:1762166756.210404:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166756.210406:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166756.210502:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37500:x1847765439975680:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1253us (1391us total) trans 4294968797 rc 0/0 00000100:00100000:1.0:1762166756.210511:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2461 00000100:00100000:3.0:1762166756.212072:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.212116:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439975808 00000100:00100000:1.0:1762166756.212122:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439975808 00000100:00080000:3.0:1762166756.212158:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166756.212174:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2462 00000100:00100000:1.0:1762166756.212184:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37500:x1847765439975808:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1762166756.212196:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.212209:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0a9fd lrc: 2/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b752e expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.212252:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.212262:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212270:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212282:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.212289:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212296:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212319:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212326:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212339:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212345:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212350:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.212353:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212359:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212368:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:1.0:1762166756.212371:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.212374:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212380:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0aa04 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212389:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212395:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212400:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212405:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.212407:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212422:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212428:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x83c42efe (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.212431:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.212434:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212439:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0aa0b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.212463:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0a9fd lrc: 1/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b752e expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.212471:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:1.0:1762166756.212473:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.212520:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0a9fd lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b752e expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.212535:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:1.0:1762166756.212575:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37500:x1847765439975808:12345-192.168.204.38@tcp:101:rm.0 Request processed in 392us (503us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166756.212582:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2462 00000100:00100000:3.0:1762166756.213756:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.213798:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439975936 00000100:00100000:1.0:1762166756.213803:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439975936 00000100:00100000:1.0:1762166756.213846:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2463 00000100:00100000:1.0:1762166756.213855:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37500:x1847765439975936:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1762166756.213866:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.213878:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa12 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7535 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.213920:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.213930:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.213938:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.213948:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.213955:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.213962:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.213980:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.213986:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.213992:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.213996:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214000:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.214013:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214026:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214035:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:1.0:1762166756.214038:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.214040:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214044:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0aa19 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214051:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214055:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214059:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214062:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.214065:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214068:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214073:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x83c42efe (ffff945cc9b89b00) 00010000:00010000:1.0:1762166756.214075:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.214077:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214080:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aa20 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x83c42efe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:1.0:1762166756.214109:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa12 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7535 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.214115:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:1.0:1762166756.214117:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.214119:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa12 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7535 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.214126:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ae00, rc 0) 00000100:00100000:1.0:1762166756.214154:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37500:x1847765439975936:12345-192.168.204.38@tcp:101:rm.0 Request processed in 302us (401us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166756.214159:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2463 00000100:00100000:2.0:1762166756.620929:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.620982:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.621011:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439976192 00000100:00100000:1.0:1762166756.621021:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439976192 00000100:00100000:3.0:1762166756.621040:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439976064 00000100:00100000:2.0:1762166756.621046:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166756.621048:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439976064 00000100:00100000:1.0:1762166756.621091:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439976320 00000100:00100000:3.0:1762166756.621097:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 558 00000100:00100000:1.0:1762166756.621097:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439976320 00000100:00100000:2.0:1762166756.621101:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166756.621111:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:332e157a-5c6a-4389-857f-15641f8aa9a8+9:2418:x1847765439976064:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166756.621136:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 364 00000100:00100000:2.0:1762166756.621143:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.621149:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765439976192:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166756.621170:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:332e157a-5c6a-4389-857f-15641f8aa9a8+9:2418:x1847765439976064:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 62us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166756.621177:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 558 00000100:00100000:1.0:1762166756.621186:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765439976192:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 41us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.621192:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 364 00000100:00100000:0.0:1762166756.621204:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 365 00000100:00100000:0.0:1762166756.621217:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439976320:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166756.621241:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439976448 00000100:00100000:1.0:1762166756.621244:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439976448 00000100:00100000:0.0:1762166756.621255:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439976320:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166756.621265:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 365 00000100:00100000:1.0:1762166756.621279:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439976576 00000100:00100000:1.0:1762166756.621283:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439976576 00000100:00080000:0.0:1762166756.621301:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166756.621315:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:2.0:1762166756.621327:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765439976448:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166756.621329:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 221 00000100:00100000:1.0:1762166756.621345:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765439976576:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166756.621381:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765439976448:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 54us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.621392:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 220 00000100:00100000:1.0:1762166756.621392:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765439976576:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.621403:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 221 00000001:02000400:0.0:1762166756.760422:0:29937:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 44b: mirror split does not create stale file ========================================================== 05:45:56 (1762166756) 00000100:00100000:0.0:1762166756.792016:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.792080:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439976704 00000100:00100000:1.0:1762166756.792090:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439976704 00000100:00100000:1.0:1762166756.792145:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2464 00000100:00100000:1.0:1762166756.792157:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37653:x1847765439976704:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1762166756.792177:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.792195:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b753c expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.792255:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792268:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792278:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792292:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792299:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792305:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792342:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792357:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792362:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792369:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792375:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.792384:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792392:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792403:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166756.792406:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.792410:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792417:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792428:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792434:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792439:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792444:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.792452:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792458:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792465:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x651521dd (ffff945cc9b89b00) 00010000:00010000:1.0:1762166756.792468:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.792471:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792493:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.792526:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b753c expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.792536:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166756.792539:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.792542:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b753c expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.792550:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:1.0:1762166756.792606:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37653:x1847765439976704:12345-192.168.204.38@tcp:101:rm.0 Request processed in 452us (616us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166756.792614:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2464 00000100:00100000:0.0:1762166756.799470:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.799542:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439976960 00000100:00100000:1.0:1762166756.799551:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439976960 00000100:00100000:1.0:1762166756.799593:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2465 00000100:00100000:1.0:1762166756.799602:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37655:x1847765439976960:12345-192.168.204.38@tcp:36:mkdir.0 00010000:00010000:1.0:1762166756.799655:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166756.799677:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc7e00/0x2f180c4effb0a7f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7494 expref: 13 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.799691:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166756.799695:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.799743:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.799757:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.799765:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.799778:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x651521dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.799782:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.799786:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800198:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800204:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800209:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166756.800218:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000012656a8f reply state 0000000013b9015a transno 4294968798 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800231:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800235:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.800237:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166756.800239:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1762166756.800243:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x11:0x0]: returning size 4096 00010000:00010000:1.0:1762166756.800249:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800253:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800258:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800261:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800265:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.800268:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800273:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800278:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166756.800280:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.800283:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800286:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166756.800301:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000012656a8f reply state 0000000013b9015a transno 4294968798 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800306:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.800311:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x651521dd (ffff945cc9b89b00) 00010000:00010000:1.0:1762166756.800312:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166756.800314:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1762166756.800399:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37655:x1847765439976960:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 797us (936us total) trans 4294968798 rc 0/0 00000100:00100000:1.0:1762166756.800407:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2465 00000100:00100000:3.0:1762166756.802179:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.802219:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439977088 00000100:00100000:1.0:1762166756.802227:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439977088 00000100:00100000:1.0:1762166756.802258:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2466 00000100:00100000:1.0:1762166756.802265:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37513:x1847765439977088:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1762166756.802280:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.802293:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0aa51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7543 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.802346:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.802357:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.802366:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.802400:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166756.802411:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.802432:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.802452:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0aa51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.802467:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.802496:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166756.802500:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166756.802503:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ba00, rc 0) 00000100:00100000:1.0:1762166756.802550:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37513:x1847765439977088:12345-192.168.204.38@tcp:101:bash.0 Request processed in 285us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.802558:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2466 00000100:00100000:3.0:1762166756.803701:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.803748:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439977216 00000100:00100000:1.0:1762166756.803755:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439977216 00000100:00100000:1.0:1762166756.803791:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2467 00000100:00100000:1.0:1762166756.803801:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37513:x1847765439977216:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1762166756.803811:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.803823:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aa5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b754a expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.803862:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.803871:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.803879:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.803897:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.803904:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.803911:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.803973:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0aa74 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.803981:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0aa74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.803988:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0aa74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.804027:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x11:0x0]: returning size 4096 00000004:00200000:1.0:1762166756.804030:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.804041:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0aa74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804051:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804058:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804065:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804071:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804085:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.804089:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804097:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804107:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166756.804110:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.804114:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804120:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aa66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804131:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804137:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804142:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804146:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.804149:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804155:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804163:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x651521dd (ffff945cc9b89b00) 00010000:00010000:1.0:1762166756.804166:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.804176:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804181:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0aa6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.804201:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aa5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b754a expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.804211:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0aa74 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b754a expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.804231:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.804234:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1762166756.804237:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a200, rc 0) 00000100:00100000:1.0:1762166756.804276:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37513:x1847765439977216:12345-192.168.204.38@tcp:101:bash.0 Request processed in 477us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.804283:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2467 00000100:00100000:0.0:1762166756.805515:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.805543:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439977472 00000100:00100000:1.0:1762166756.805548:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439977472 00000100:00100000:1.0:1762166756.805580:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2468 00000100:00100000:1.0:1762166756.805588:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37513:x1847765439977472:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1762166756.805599:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.805611:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa7b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7551 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.805689:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.805699:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.805715:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.805731:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.805738:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.805746:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00080000:1.0:1762166756.806019:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3b:0x0], index 1: 0 00010000:00010000:1.0:1762166756.806134:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806141:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806147:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806171:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806175:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806179:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806183:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806194:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cade00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.806196:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806201:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806208:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.806210:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.806213:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 3/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806217:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aa82 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166756.806227:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004ff59750 reply state 00000000c00341fe transno 4294968799 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806234:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.806238:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cc9b89d00) 00010000:00010000:1.0:1762166756.806239:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166756.806241:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166756.806259:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0aa7b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 19 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.806271:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.806276:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.806283:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166756.806285:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cada00, rc 0) 00000100:00100000:1.0:1762166756.806332:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37513:x1847765439977472:12345-192.168.204.38@tcp:101:bash.0 Request processed in 744us (818us total) trans 4294968799 rc 0/0 00000100:00100000:1.0:1762166756.806341:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2468 00000100:00100000:3.0:1762166756.807926:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.808089:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439977600 00000100:00100000:0.0:1762166756.808097:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439977600 00000100:00100000:0.0:1762166756.808151:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 874 00000100:00100000:0.0:1762166756.808164:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:37513:x1847765439977600:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1762166756.808179:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166756.808198:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7558 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166756.808290:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166756.808309:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.808311:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.808320:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 9 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.808336:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 9 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.808347:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2c00, rc 0) 00000100:00100000:0.0:1762166756.808399:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:37513:x1847765439977600:12345-192.168.204.38@tcp:101:bash.0 Request processed in 238us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166756.808408:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 874 00000100:00100000:2.0:1762166756.809750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.809788:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439977856 00000100:00100000:0.0:1762166756.809793:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439977856 00000100:00100000:0.0:1762166756.809828:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 702 00000100:00100000:0.0:1762166756.809839:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37513:x1847765439977856:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:0.0:1762166756.810080:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:37513:x1847765439977856:12345-192.168.204.38@tcp:35:bash.0 Request processed in 243us (331us total) trans 4294968800 rc 0/0 00000100:00100000:0.0:1762166756.810101:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 702 00000100:00100000:1.0:1762166756.817622:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.817694:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439978112 00000100:00100000:0.0:1762166756.817708:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439978112 00000100:00100000:0.0:1762166756.817771:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2469 00000100:00100000:0.0:1762166756.817784:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:37660:x1847765439978112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166756.817807:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166756.817838:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aaa5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b755f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.817939:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.817955:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 21 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.817966:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 4/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.818013:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 21 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.818027:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 21 pid: 7432 timeout: 475 lvb_type: 0 00000100:00100000:0.0:1762166756.818040:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe36300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446774528:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166756.818130:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166756.818936:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe36300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446774528:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166756.818951:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.819153:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.819191:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439978240 00000100:00100000:2.0:1762166756.819196:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439978240 00010000:00010000:2.0:1762166756.819218:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 22 pid: 7432 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1762166756.819246:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 568 00000100:00100000:2.0:1762166756.819253:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:2419:x1847765439978240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.819263:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.819269:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 22 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.819280:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 22 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.819310:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0aa90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7551 expref: 22 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.819322:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166756.819326:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.819334:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.819340:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.819365:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.819392:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.819401:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.819404:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:2419:x1847765439978240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.819419:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 568 00000004:00200000:1.0:1762166756.819424:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166756.819569:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aaa5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.819585:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 21 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.819593:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.819596:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166756.819598:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3a00, rc 0) 00000100:00100000:1.0:1762166756.819635:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37660:x1847765439978112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1855us (2020us total) trans 4294968801 rc 0/0 00000100:00100000:1.0:1762166756.819652:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2469 00000100:00100000:1.0:1762166756.820991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.821053:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439978496 00000100:00100000:0.0:1762166756.821060:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439978496 00000100:00100000:0.0:1762166756.821102:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2470 00000100:00100000:0.0:1762166756.821111:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37660:x1847765439978496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166756.821131:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166756.821142:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0aaba lrc: 2/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7566 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.821508:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.821520:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.821529:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166756.821537:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x13:0x0]: returning size 0 00010000:00010000:0.0:1762166756.821569:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0aaba lrc: 0/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.821584:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.821592:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945bc403ae00) 00010000:00010000:0.0:1762166756.821594:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166756.821597:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2800, rc 0) 00000100:00100000:0.0:1762166756.821639:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37660:x1847765439978496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 529us (653us total) trans 4294968802 rc 0/0 00000100:00100000:0.0:1762166756.821647:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2470 00000100:00100000:0.0:1762166756.824221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.824274:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439978752 00000100:00100000:1.0:1762166756.824284:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439978752 00000100:00100000:1.0:1762166756.824336:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2471 00000100:00100000:1.0:1762166756.824347:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37660:x1847765439978752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.824368:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.824383:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aacf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b756d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.824462:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.824475:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.824506:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.824535:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.824550:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 24 pid: 7432 timeout: 475 lvb_type: 0 00000100:00100000:1.0:1762166756.824564:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446774656:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166756.824635:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166756.825737:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446774656:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166756.825764:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166756.827219:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.827298:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439978880 00000100:00100000:2.0:1762166756.827308:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439978880 00010000:00010000:2.0:1762166756.827337:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 25 pid: 7432 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1762166756.827372:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 569 00000100:00100000:2.0:1762166756.827381:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2418:x1847765439978880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.827395:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.827402:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 25 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.827428:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 25 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.827448:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0aac1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7566 expref: 25 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.827463:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945bc403ae00) 00010000:00010000:2.0:1762166756.827468:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.827502:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.827510:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.827535:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.827570:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.827580:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.827582:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:2418:x1847765439978880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 201us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.827595:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 569 00000004:00200000:1.0:1762166756.827598:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x13:0x0]: returning size 0 00000004:00080000:1.0:1762166756.827743:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3e:0x0], index 0: 0 00010000:00010000:1.0:1762166756.827837:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.827845:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.827850:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.827856:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.827860:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.827867:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.827876:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945bc403ae00) 00010000:00010000:1.0:1762166756.827879:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166756.827882:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.827886:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0aad6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.827939:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aacf lrc: 1/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b756d expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.827946:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.827948:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166756.827950:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0aacf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b756d expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.827956:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cade00, rc 0) 00000100:00100000:1.0:1762166756.827980:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37660:x1847765439978752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3637us (3767us total) trans 4294968803 rc 301/301 00000100:00100000:1.0:1762166756.827985:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2471 00000100:00100000:0.0:1762166756.829155:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.829207:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439979136 00000100:00100000:1.0:1762166756.829213:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439979136 00000100:00100000:1.0:1762166756.829248:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 703 00000100:00100000:1.0:1762166756.829259:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37660:x1847765439979136:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166756.829399:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37660:x1847765439979136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 144us (247us total) trans 4294968804 rc 0/0 00000100:00100000:1.0:1762166756.829404:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 703 00000100:00100000:3.0:1762166756.830663:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.830702:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439979264 00000100:00100000:1.0:1762166756.830708:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439979264 00000100:00100000:1.0:1762166756.830739:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2472 00000100:00100000:1.0:1762166756.830748:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37660:x1847765439979264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.830762:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.830777:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0aae4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7574 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.830857:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.830869:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.830876:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.830906:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.830919:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 25 pid: 7432 timeout: 475 lvb_type: 0 00000100:00100000:1.0:1762166756.830932:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446774784:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166756.830990:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166756.831727:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446774784:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166756.831743:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166756.831908:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.831948:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439979392 00000100:00100000:2.0:1762166756.831953:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439979392 00010000:00010000:2.0:1762166756.831970:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 26 pid: 7432 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1762166756.832007:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 570 00000100:00100000:2.0:1762166756.832015:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:2418:x1847765439979392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.832024:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.832034:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 26 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.832042:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 26 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.832055:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aaac lrc: 0/0,0 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b755f expref: 26 pid: 7432 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.832064:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166756.832067:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.832072:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.832076:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.832091:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.832116:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.832117:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2418:x1847765439979392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.832131:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 570 00010000:00010000:1.0:1762166756.832131:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.832164:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166756.832170:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.832192:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.832216:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0aae4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7574 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.832229:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7574 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.832238:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.832240:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166756.832243:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac800, rc 0) 00000100:00100000:1.0:1762166756.832277:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37660:x1847765439979264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1530us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.832284:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2472 00000100:00100000:3.0:1762166756.833431:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.833473:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439979520 00000100:00100000:1.0:1762166756.833500:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439979520 00000100:00100000:1.0:1762166756.833529:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2473 00000100:00100000:1.0:1762166756.833534:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37660:x1847765439979520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.833544:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.833555:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0aaf2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b757b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.833588:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0aaf9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.833596:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0aaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.833605:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0aaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.833634:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x13:0x0]: returning size 0 00000004:00200000:1.0:1762166756.833637:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.833645:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0aaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.833657:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0aaf2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b757b expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.833665:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0aaf9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b757b expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.833670:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:1.0:1762166756.833671:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166756.833673:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00000100:00100000:1.0:1762166756.833698:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37660:x1847765439979520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 164us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.833703:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2473 00000100:00100000:0.0:1762166756.834684:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.834728:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439979648 00000100:00100000:2.0:1762166756.834734:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439979648 00000100:00100000:2.0:1762166756.834771:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 875 00000100:00100000:2.0:1762166756.834780:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765439979648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166756.834791:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166756.834805:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7582 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166756.834902:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166756.834919:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.834921:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.834928:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.834942:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.834954:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9e800, rc 0) 00000100:00100000:2.0:1762166756.835002:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439979648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 213us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.835009:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 875 00000100:00100000:0.0:1762166756.835973:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.836021:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439979904 00000100:00100000:1.0:1762166756.836028:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439979904 00000100:00100000:1.0:1762166756.836063:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2474 00000100:00100000:1.0:1762166756.836073:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37660:x1847765439979904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.836083:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.836095:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab07 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7589 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.836174:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ab0e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.836185:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ab0e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.836201:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ab0e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.836213:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166756.836297:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab07 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7589 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.836311:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ab0e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7589 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.836319:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.836321:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166756.836324:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad200, rc 0) 00000100:00100000:1.0:1762166756.836360:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+27:37660:x1847765439979904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 289us (388us total) trans 4294968805 rc 0/0 00000100:00100000:1.0:1762166756.836368:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2474 00000100:00100000:3.0:1762166756.837665:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.837701:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439980032 00000100:00100000:2.0:1762166756.837711:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439980032 00000100:00100000:2.0:1762166756.837745:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 876 00000100:00100000:2.0:1762166756.837754:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765439980032:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166756.837778:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.837789:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 9 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.837794:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166756.837795:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166756.837797:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.837825:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 9 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.837834:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 9 pid: 8383 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1762166756.837844:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446774912:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166756.837890:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166756.838620:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446774912:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166756.838633:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166756.839864:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.839934:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439980160 00000100:00100000:0.0:1762166756.839940:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439980160 00002000:00100000:0.0:1762166756.839968:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x3b:0x0] (0->3) req@ffff945cf3db6a00 x1847765439980160/t0(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:542/0 lens 496/0 e 0 to 0 dl 1762166767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166756.839987:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6a00 with x1847765439980160 ext(0->3) 00010000:00010000:0.0:1762166756.840005:0:23943:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 10 pid: 8383 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1762166756.840014:0:23943:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 10 pid: 8383 timeout: 475 lvb_type: 0 00002000:00010000:0.0:1762166756.840019:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945cf3db6a00 00000100:00100000:0.0:1762166756.840038:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:0.0:1762166756.840044:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439980160:12345-192.168.204.38@tcp:4:bash.0 00000100:00100000:0.0:1762166756.840557:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:2418:x1847765439980160:12345-192.168.204.38@tcp:4:bash.0 Request processed in 514us (694us total) trans 17179869318 rc 0/0 00000100:00100000:0.0:1762166756.840564:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00002000:00100000:0.0:1762166756.840570:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x3b:0x0] (0->3) req@ffff945cf3db6a00 x1847765439980160/t17179869318(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:542/0 lens 496/448 e 0 to 0 dl 1762166767 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166756.840576:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6a00 with x1847765439980160 ext(0->3) 00010000:00010000:0.0:1762166756.840580:0:23943:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 12 pid: 8383 timeout: 475 lvb_type: 0 00010000:00010000:0.0:1762166756.840596:0:23943:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 12 pid: 8383 timeout: 475 lvb_type: 0 00002000:00010000:0.0:1762166756.840601:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945cf3db6a00 00000100:00100000:0.0:1762166756.841666:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.841707:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439980288 00000100:00100000:2.0:1762166756.841712:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439980288 00010000:00010000:2.0:1762166756.841729:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 12 pid: 8383 timeout: 475 lvb_type: 0 00000100:00100000:2.0:1762166756.841751:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 571 00000100:00100000:2.0:1762166756.841756:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:2419:x1847765439980288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.841765:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1762166756.841774:0:8398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb size from disk: 0 -> 4 00002000:00010000:2.0:1762166756.841776:0:8398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb mtime from disk: 0 -> 1762166757 00002000:00010000:2.0:1762166756.841778:0:8398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb ctime from disk: 0 -> 1762166757 00002000:00010000:2.0:1762166756.841779:0:8398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1762166756.841784:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 12 pid: 8383 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.841801:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 12 pid: 8383 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.841821:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aa9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7558 expref: 12 pid: 8383 timeout: 475 lvb_type: 0 00010000:00010000:2.0:1762166756.841834:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.841836:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.841840:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.841849:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.841875:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166756.841897:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.841904:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166756.841909:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2419:x1847765439980288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.841919:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 571 00010000:00010000:0.0:1762166756.841921:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.841929:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.841937:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.841943:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9f800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166756.841947:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.841954:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.841979:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.841985:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ab1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166756.842046:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765439980032:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 4293us (4381us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166756.842054:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 876 00000100:00100000:0.0:1762166756.843333:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.843382:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439980416 00000100:00100000:2.0:1762166756.843389:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439980416 00000100:00100000:2.0:1762166756.843427:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 877 00000100:00100000:2.0:1762166756.843436:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765439980416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166756.843449:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166756.843503:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7590 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166756.843523:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 4, mtime: 0x690887e5, atime: 0x0, ctime: 0x690887e5, blocks: 0x8 00010000:00010000:2.0:1762166756.843546:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.843548:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.843554:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 11 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.843570:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 11 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.843581:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9ec00, rc 0) 00000100:00100000:2.0:1762166756.843624:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2419:x1847765439980416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 189us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.843630:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 877 00000100:00100000:3.0:1762166756.866967:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.867086:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439980544 00000100:00100000:2.0:1762166756.867101:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439980544 00000100:00100000:2.0:1762166756.867167:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 878 00000100:00100000:2.0:1762166756.867178:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2418:x1847765439980544:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166756.867300:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2418:x1847765439980544:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 124us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.867308:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 878 00000100:00100000:3.0:1762166756.868540:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.868616:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439980672 00000100:00100000:0.0:1762166756.868627:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439980672 00000100:00100000:0.0:1762166756.868697:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 430 00000100:00100000:0.0:1762166756.868706:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2419:x1847765439980672:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166756.868745:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868764:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.868766:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.868772:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868789:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868903:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868933:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868942:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868949:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166756.868953:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868962:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868980:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.868988:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0ab2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166756.869059:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2419:x1847765439980672:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 354us (523us total) trans 0 rc 4/4 00000100:00100000:0.0:1762166756.869067:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 430 00000100:00100000:0.0:1762166756.870198:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.870261:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439980800 00000100:00100000:1.0:1762166756.870271:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439980800 00000100:00100000:1.0:1762166756.870328:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2475 00000100:00100000:1.0:1762166756.870340:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+27:37660:x1847765439980800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.870362:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.870383:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab31 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7597 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.870415:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.870427:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.870452:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.870591:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab31 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.870609:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.870618:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:1.0:1762166756.870621:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166756.870624:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad800, rc 0) 00000100:00100000:1.0:1762166756.870677:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+28:37660:x1847765439980800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 340us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.870685:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2475 00000100:00100000:3.0:1762166756.871924:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.871975:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439980928 00000100:00100000:0.0:1762166756.871984:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439980928 00000100:00100000:0.0:1762166756.872062:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 431 00000100:00100000:0.0:1762166756.872074:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439980928:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166756.872140:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.872160:0:23943:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166756.872170:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.872172:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.872176:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.872218:0:23943:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166756.872233:0:23943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 10 pid: 8383 timeout: 476 lvb_type: 1 00000100:00100000:0.0:1762166756.872251:0:23943:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:23943:1847765446775040:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166756.872360:0:23943:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79aef00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166756.873220:0:23943:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:23943:1847765446775040:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166756.873244:0:23943:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166756.873568:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.873613:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439981056 00000100:00100000:2.0:1762166756.873621:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439981056 00010000:00010000:2.0:1762166756.873650:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 11 pid: 8383 timeout: 476 lvb_type: 1 00000100:00100000:2.0:1762166756.873679:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 572 00000100:00100000:2.0:1762166756.873689:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2418:x1847765439981056:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.873703:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.873729:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 11 pid: 8383 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.873743:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 11 pid: 8383 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.873766:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ab00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7582 expref: 11 pid: 8383 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.873780:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.873781:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.873785:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.873791:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.873812:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166756.873843:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439981056:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 157us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.873849:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 572 00010000:00010000:0.0:1762166756.873849:0:23943:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.873864:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166756.875407:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836637 is committed 00000001:00080000:1.0:1762166756.875419:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836636 is committed 00000001:00080000:1.0:1762166756.875430:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836632 is committed 00002000:00010000:0.0:1762166756.875531:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb size from disk: 0 -> 4 00002000:00010000:0.0:1762166756.875536:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb mtime from disk: 0 -> 1762166757 00002000:00010000:0.0:1762166756.875539:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb ctime from disk: 0 -> 1762166757 00002000:00010000:0.0:1762166756.875542:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1762166756.875554:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.875566:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.875576:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.875583:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166756.875588:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.875597:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.875617:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.875625:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0ab3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166756.875713:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2418:x1847765439980928:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3633us (3786us total) trans 21474836637 rc 0/0 00000100:00100000:0.0:1762166756.875738:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 431 00000100:00100000:3.0:1762166756.876854:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.876909:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439981184 00000100:00100000:1.0:1762166756.876919:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439981184 00000100:00100000:1.0:1762166756.876975:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2476 00000100:00100000:1.0:1762166756.876988:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+28:37660:x1847765439981184:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166756.878217:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968805 is committed 00000004:00080000:3.0:1762166756.878245:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00010000:00010000:0.0:1762166756.878253:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000004:00080000:3.0:1762166756.878260:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 87 committed 00010000:00010000:0.0:1762166756.878267:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878278:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878285:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166756.878292:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878300:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878323:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0xff6e0927 (ffff945cc9b89f00) 00010000:00010000:0.0:1762166756.878327:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166756.878333:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878340:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0a9e8 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xe:0x0].0xff6e0927 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878371:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878377:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878382:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166756.878390:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446775168:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166756.878395:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166756.878399:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878404:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878413:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x651521dd (ffff945cc9b89b00) 00010000:00010000:0.0:1762166756.878415:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166756.878417:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.878424:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446775296:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166756.878424:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0aa43 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x651521dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878452:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166756.878457:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166756.878463:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.878469:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37660:x1847765439981184:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1481us (1614us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166756.878474:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878520:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166756.878523:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.878528:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2476 00010000:00010000:0.0:1762166756.878536:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878547:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:0.0:1762166756.878555:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166756.878559:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.878567:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166756.878569:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0aa4a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878582:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878586:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878591:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878595:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166756.878596:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878600:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.878609:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cc9b89d00) 00010000:00010000:0.0:1762166756.878612:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166756.878615:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166756.878622:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446775168 00010000:00010000:0.0:1762166756.878622:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0aa89 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166756.878628:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446775168 00000100:00080000:0.0:1762166756.878678:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166756.878694:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446775296 00000100:00100000:0.0:1762166756.878709:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1762166756.878724:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446775168:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166756.878737:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446775296 00002000:00080000:0.0:1762166756.878753:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:60 count 1 00000100:00100000:3.0:1762166756.878774:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1762166756.878780:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446775296:12345-0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1762166756.878781:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:1.0:1762166756.878786:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1762166756.878791:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1762166756.878796:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:57 count 1 00010000:00010000:0.0:1762166756.878802:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.878804:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.878810:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166756.878812:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.878822:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.878829:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166756.878831:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 10 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166756.878836:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166756.878851:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166756.878854:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166756.878857:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.878866:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166756.878887:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166756.878893:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 10 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.878899:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.878915:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166756.878917:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 10 pid: 9168 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.878936:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166756.878944:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446775424:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166756.878954:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.878979:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.878987:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0ab46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166756.879017:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb49c0 going to sleep for 11 seconds 00010000:00010000:2.0:1762166756.879046:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166756.879052:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166756.879058:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166756.879134:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446775168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 413us (677us total) trans 21474836638 rc 0/0 00000100:00100000:0.0:1762166756.879142:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1762166756.879159:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836636 gen 2 00000004:00080000:3.0:1762166756.879164:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4944a80, transno 21474836633 00000004:00080000:3.0:1762166756.879173:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4946a00, transno 21474836634 00000004:00080000:3.0:1762166756.879175:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6c700, transno 21474836635 00000004:00080000:3.0:1762166756.879177:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406d500, transno 21474836636 00000100:00100000:3.0:1762166756.879184:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf1e6fb80 x1847765446775168/t21474836638(21474836638) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166772 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166756.879194:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6fb80/2, rc 0, transno 21474836638 00000100:00100000:3.0:1762166756.879200:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446775168:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1762166756.879257:0:9163:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 1 in progress, 0 in flight, 4 done 00000100:00100000:1.0:1762166756.879782:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446775424:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166756.879784:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166756.879801:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166756.879829:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439981312 00000100:00100000:0.0:1762166756.879834:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439981312 00000100:00100000:0.0:1762166756.879867:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 881 00000100:00100000:0.0:1762166756.879876:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765439981312:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166756.879940:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765439981312:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166756.879956:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 881 00000100:00100000:1.0:1762166756.880018:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.880059:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439981440 00000100:00100000:2.0:1762166756.880069:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439981440 00010000:00010000:2.0:1762166756.880102:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 11 pid: 9168 timeout: 476 lvb_type: 1 00000100:00100000:2.0:1762166756.880135:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 573 00000100:00100000:2.0:1762166756.880144:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2419:x1847765439981440:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.880155:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.880158:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 11 pid: 9168 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.880167:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 11 pid: 9168 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.880188:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0a9da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7527 expref: 11 pid: 9168 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.880197:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.880199:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.880202:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.880208:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.880228:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.880249:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.880258:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.880265:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166756.880274:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765439981440:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (251us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166756.880282:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166756.880292:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 573 00010000:00010000:1.0:1762166756.880316:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166756.880342:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166756.880351:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.880363:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166756.880368:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.880379:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.880395:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.880403:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0ab4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.880425:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166756.880429:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166756.880431:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166756.880536:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765446775296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1753us (1977us total) trans 17179869319 rc 0/0 00000004:00080000:2.0:1762166756.880541:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc558b100/2, rc 0, transno 17179869319 00000100:00100000:1.0:1762166756.880551:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1762166756.880562:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446775296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166756.887769:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.887819:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439981568 00000100:00100000:1.0:1762166756.887830:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439981568 00000100:00100000:1.0:1762166756.887897:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 882 00000100:00100000:1.0:1762166756.887910:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765439981568:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166756.887969:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888020:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166756.888024:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166756.888029:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888041:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888065:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888071:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888076:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888080:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cade00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166756.888084:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888092:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888106:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.888127:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166756.888215:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765439981568:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 309us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.888221:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 882 00000100:00100000:3.0:1762166756.889394:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.889448:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439981824 00000100:00100000:1.0:1762166756.889456:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439981824 00000100:00100000:1.0:1762166756.889527:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2477 00000100:00100000:1.0:1762166756.889537:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37660:x1847765439981824:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166756.889601:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166756.889627:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0aaf9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b757b expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.889645:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:1.0:1762166756.889650:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.889680:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.889694:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.889702:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166756.889847:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000025c60d73 reply state 000000003451f54e transno 4294968806 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.889874:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.889880:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:1.0:1762166756.889884:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166756.889887:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166756.889981:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37660:x1847765439981824:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 445us (590us total) trans 4294968806 rc 0/0 00000100:00100000:1.0:1762166756.889989:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2477 00000100:00100000:2.0:1762166756.890865:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.890901:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439981952 00000100:00100000:1.0:1762166756.890908:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439981952 00000100:00100000:1.0:1762166756.890945:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2478 00000100:00100000:1.0:1762166756.890953:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37660:x1847765439981952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.890970:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.890983:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b759e expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.891035:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.891047:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.891065:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:1.0:1762166756.891067:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166756.891070:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac200, rc 0) 00000100:00100000:1.0:1762166756.891110:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37660:x1847765439981952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 157us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.891128:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2478 00000100:00100000:3.0:1762166756.892067:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.892106:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439982080 00000100:00100000:1.0:1762166756.892113:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439982080 00000100:00100000:1.0:1762166756.892147:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 883 00000100:00100000:1.0:1762166756.892153:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2418:x1847765439982080:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166756.892289:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765439982080:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 136us (223us total) trans 21474836639 rc 0/0 00000100:00100000:1.0:1762166756.892294:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 883 00000100:00100000:3.0:1762166756.893107:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.893151:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439982336 00000100:00100000:1.0:1762166756.893157:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439982336 00000100:00100000:1.0:1762166756.893192:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2479 00000100:00100000:1.0:1762166756.893201:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37660:x1847765439982336:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166756.893246:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.893260:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.893270:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.893307:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.893324:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 17 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166756.893346:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446775552:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166756.893430:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166756.894205:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446775552:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166756.894225:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166756.894365:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.894412:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439982464 00000100:00100000:2.0:1762166756.894418:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439982464 00010000:00010000:2.0:1762166756.894443:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166756.894503:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 574 00000100:00100000:2.0:1762166756.894513:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:2419:x1847765439982464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.894523:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.894535:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.894545:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.894560:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ab38 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x13:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7597 expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.894571:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:2.0:1762166756.894574:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.894580:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.894584:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.894605:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.894621:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.894628:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.894643:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2419:x1847765439982464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.894651:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 574 00010000:00010000:1.0:1762166756.894654:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.894660:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.894665:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.894669:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cace00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.894673:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.894678:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.894685:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:1.0:1762166756.894687:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166756.894690:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.894694:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ab69 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.894737:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37660:x1847765439982336:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1539us (1631us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166756.894744:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2479 00000100:00100000:3.0:1762166756.895576:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.895624:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439982720 00000100:00100000:1.0:1762166756.895629:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439982720 00000100:00100000:1.0:1762166756.895665:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2480 00000100:00100000:1.0:1762166756.895676:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37660:x1847765439982720:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166756.895731:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166756.895746:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0aaeb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7574 expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.895759:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.895763:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.895810:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.895821:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.895829:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166756.895936:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c17d9d3c reply state 00000000458ffbf1 transno 4294968807 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.895949:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.895955:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.895966:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166756.895969:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166756.896055:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37660:x1847765439982720:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 382us (483us total) trans 4294968807 rc 0/0 00000100:00100000:1.0:1762166756.896062:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2480 00000100:00100000:2.0:1762166756.896838:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.896886:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439982848 00000100:00100000:1.0:1762166756.896892:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439982848 00000100:00100000:1.0:1762166756.896930:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2481 00000100:00100000:1.0:1762166756.896939:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37660:x1847765439982848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.896955:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.896966:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75a5 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.897026:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.897044:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.897062:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.897066:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166756.897069:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad000, rc 0) 00000100:00100000:1.0:1762166756.897106:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37660:x1847765439982848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 168us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.897114:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2481 00000100:00100000:3.0:1762166756.898020:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.898064:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439982976 00000100:00100000:1.0:1762166756.898070:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439982976 00000100:00100000:1.0:1762166756.898113:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 884 00000100:00100000:1.0:1762166756.898123:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439982976:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166756.898269:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:1.0:1762166756.898273:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb mtime from disk: 1762166757 -> 1762166757 00002000:00010000:1.0:1762166756.898276:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb atime from disk: 0 -> 1762166757 00002000:00010000:1.0:1762166756.898279:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb ctime from disk: 1762166757 -> 1762166757 00002000:00010000:1.0:1762166756.898281:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1762166756.898324:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2418:x1847765439982976:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 203us (305us total) trans 17179869320 rc 0/0 00000100:00100000:1.0:1762166756.898334:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 884 00000100:00100000:3.0:1762166756.899284:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.899336:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439983232 00000100:00100000:1.0:1762166756.899343:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439983232 00000100:00100000:1.0:1762166756.899388:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 704 00000100:00100000:1.0:1762166756.899398:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37660:x1847765439983232:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166756.899466:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000403:0x12:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ab0e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7589 expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.899530:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.899545:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.899554:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.899592:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.899608:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166756.899642:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446775680:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166756.899716:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166756.900653:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446775680:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166756.900671:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166756.900853:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.900909:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439983360 00000100:00100000:2.0:1762166756.900917:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439983360 00010000:00010000:2.0:1762166756.900948:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 19 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166756.900984:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 575 00000100:00100000:2.0:1762166756.901008:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:2419:x1847765439983360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.901033:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.901040:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 19 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.901053:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 19 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.901070:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ab77 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75a5 expref: 19 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.901087:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166756.901092:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166756.901101:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166756.901108:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166756.901133:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.901149:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.901156:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.901170:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166756.901178:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:2419:x1847765439983360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 186us (331us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166756.901180:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.901195:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166756.901198:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 575 00010000:00010000:1.0:1762166756.901228:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.901239:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 17 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166756.901249:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446775808:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166756.901292:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166756.901935:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446775808:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166756.901950:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166756.902147:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.902192:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439983488 00000100:00100000:2.0:1762166756.902198:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439983488 00010000:00010000:2.0:1762166756.902214:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166756.902232:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 576 00000100:00100000:2.0:1762166756.902242:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:2418:x1847765439983488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.902251:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.902255:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.902263:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.902272:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0ab62 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b759e expref: 18 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.902281:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:2.0:1762166756.902284:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166756.902289:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166756.902293:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166756.902309:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.902328:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.902335:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166756.902340:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2418:x1847765439983488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.902347:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 576 00000100:00100000:1.0:1762166756.902656:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446775936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166756.902699:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166756.902728:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166756.902750:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446775936 00000100:00100000:2.0:1762166756.902755:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446775936 00000100:00100000:2.0:1762166756.902801:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1762166756.902810:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6498:x1847765446775936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166756.902898:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6498:x1847765446775936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.902913:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1762166756.902928:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446775936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166756.903001:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446776064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166756.903025:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166756.903044:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd1ae6240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166756.903070:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446776064 00000100:00100000:2.0:1762166756.903075:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446776064 00000100:00100000:2.0:1762166756.903100:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1762166756.903104:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446776064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166756.903157:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446776064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.903164:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1762166756.903184:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446776064:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:1.0:1762166756.903304:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].18, 280 off45216 00000001:00080000:1.0:1762166756.903313:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968808 00000100:00100000:1.0:1762166756.903341:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446776192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166756.903357:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166756.903375:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd1ae6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166756.903387:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446776192 00000100:00100000:2.0:1762166756.903391:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446776192 00000100:00100000:2.0:1762166756.903415:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1762166756.903421:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446776192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166756.903549:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6498:x1847765446776192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (189us total) trans 21474836640 rc 0/0 00000100:00100000:2.0:1762166756.903556:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1762166756.903567:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446776192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166756.903588:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446776320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166756.903609:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166756.903634:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166756.903643:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446776320 00000100:00100000:2.0:1762166756.903646:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446776320 00000100:00100000:2.0:1762166756.903672:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1762166756.903678:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6498:x1847765446776320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166756.903745:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6498:x1847765446776320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 66us (134us total) trans 17179869321 rc 0/0 00000100:00100000:2.0:1762166756.903752:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1762166756.903766:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446776320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166756.903802:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968809 00010000:00010000:1.0:1762166756.903819:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903826:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903831:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903835:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.903838:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903843:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903850:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:1.0:1762166756.903852:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166756.903854:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903858:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ab85 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903865:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903869:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903873:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903881:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cade00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.903882:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903886:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903890:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.903891:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166756.903893:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903896:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ab7e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.903903:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.903905:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166756.903908:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ab0e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7589 expref: 19 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166756.903968:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37660:x1847765439983232:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4573us (4686us total) trans 4294968810 rc 0/0 00000100:00100000:1.0:1762166756.903973:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 704 00000020:00080000:1.0:1762166756.903975:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166756.904798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.904834:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439983616 00000100:00100000:1.0:1762166756.904839:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439983616 00000100:00100000:1.0:1762166756.904865:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2482 00000100:00100000:1.0:1762166756.904871:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37660:x1847765439983616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.904884:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.904908:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ab8c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75ac expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.904951:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ab8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ac expref: 19 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.904965:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ab8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ac expref: 19 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.904982:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.904985:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166756.904988:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00000100:00100000:1.0:1762166756.905035:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37660:x1847765439983616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 163us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.905043:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2482 00000100:00100000:3.0:1762166756.906115:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.906164:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439983872 00000100:00100000:1.0:1762166756.906173:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439983872 00000100:00100000:1.0:1762166756.906201:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 705 00000100:00100000:1.0:1762166756.906208:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37660:x1847765439983872:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166756.906336:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:37660:x1847765439983872:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 127us (224us total) trans 4294968811 rc 0/0 00000100:00100000:1.0:1762166756.906345:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 705 00000100:00100000:3.0:1762166756.907034:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.907086:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439984128 00000100:00100000:1.0:1762166756.907093:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439984128 00000100:00100000:1.0:1762166756.907135:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 706 00000100:00100000:1.0:1762166756.907143:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:37660:x1847765439984128:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166756.907245:0:6498:0:(mdd_object.c:3965:mdd_close()) Object [0x200000403:0x13:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166756.907302:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.907311:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.907317:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.907323:0:6498:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.907327:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.907330:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166756.907348:0:6498:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166756.907388:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166756.907397:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166756.907406:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166756.907409:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166756.907417:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166756.907431:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:3.0:1762166756.907434:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166756.907437:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166756.907441:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ab93 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166756.907456:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166756.907459:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166756.907460:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166756.907518:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37660:x1847765439984128:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 374us (487us total) trans 4294968812 rc 0/0 00000100:00100000:1.0:1762166756.907527:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 706 00000100:00100000:3.0:1762166756.909521:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.909561:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439984384 00000100:00100000:1.0:1762166756.909569:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439984384 00000100:00100000:1.0:1762166756.909611:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2483 00000100:00100000:1.0:1762166756.909618:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37513:x1847765439984384:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1762166756.909637:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.909651:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ab9a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75b3 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.909764:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.909791:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.909801:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.909817:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.909824:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.909831:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.909882:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0abaf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.909889:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0abaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.909895:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0abaf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.909904:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166756.910012:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910027:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910036:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910043:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910058:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cace00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.910062:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910069:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910080:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.910082:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.910084:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910089:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0aba1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910098:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910102:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910105:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910108:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cacc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.910109:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910112:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910116:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd0738300) 00010000:00010000:1.0:1762166756.910123:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.910131:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910135:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0aba8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.910169:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ab9a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75b3 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.910178:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0abaf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75b3 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.910183:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.910184:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166756.910186:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad000, rc 0) 00000100:00100000:1.0:1762166756.910232:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37513:x1847765439984384:12345-192.168.204.38@tcp:101:bash.0 Request processed in 615us (718us total) trans 4294968813 rc 0/0 00000100:00100000:1.0:1762166756.910236:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2483 00000100:00100000:0.0:1762166756.911454:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.911525:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439984512 00000100:00100000:1.0:1762166756.911533:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439984512 00000100:00100000:1.0:1762166756.911575:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2484 00000100:00100000:1.0:1762166756.911585:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37513:x1847765439984512:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1762166756.911602:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.911614:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0abbd lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75ba expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.911635:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.911642:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.911654:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.911721:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0abbd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.911732:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.911737:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.911739:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166756.911741:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac200, rc 0) 00000100:00100000:1.0:1762166756.911778:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37513:x1847765439984512:12345-192.168.204.38@tcp:101:bash.0 Request processed in 195us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.911786:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2484 00000100:00100000:3.0:1762166756.912620:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.912657:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439984768 00000100:00100000:1.0:1762166756.912664:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439984768 00000100:00100000:1.0:1762166756.912696:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2485 00000100:00100000:1.0:1762166756.912702:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37513:x1847765439984768:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:1.0:1762166756.912734:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166756.912745:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0abaf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75b3 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.912754:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.912757:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.912885:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.912901:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.912905:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000001:00080000:1.0:1762166756.912944:0:7432:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968814 00000004:00010000:1.0:1762166756.912959:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bba2f06f reply state 000000002a15043e transno 4294968815 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.912967:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.912971:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.912973:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166756.912975:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166756.913034:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:37513:x1847765439984768:12345-192.168.204.38@tcp:36:bash.0 Request processed in 333us (419us total) trans 4294968815 rc 0/0 00000100:00100000:1.0:1762166756.913039:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2485 00000020:00080000:1.0:1762166756.913042:0:7432:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166756.913780:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.913825:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439985024 00000100:00100000:1.0:1762166756.913833:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439985024 00000100:00100000:1.0:1762166756.913870:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2486 00000100:00100000:1.0:1762166756.913881:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:37513:x1847765439985024:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1762166756.913896:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.913899:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166756.913912:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ab8c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ac expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.913925:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.913937:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.913947:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0abd2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75c1 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.913983:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0abd9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.914005:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0abd9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.914013:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0abd9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:1.0:1762166756.914189:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].96, 88 off15992 00000004:00080000:1.0:1762166756.914197:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376062719071ns, next at 376358321105ns, rc = 0 00000040:00080000:1.0:1762166756.914242:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].100, 88 off16320 00000004:00080000:1.0:1762166756.914247:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376062769462ns, next at 376358357885ns, rc = 0 00000001:00080000:3.0:1762166756.915278:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968816 is committed 00000004:00080000:3.0:1762166756.915287:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00000004:00080000:3.0:1762166756.915303:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 88 committed 00010000:00010000:0.0:1762166756.915324:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000020:00080000:3.0:1762166756.915338:0:6475:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc7c0f300 refcount 2 committed 0 result 0 batchid 41 00010000:00010000:0.0:1762166756.915338:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000020:00080000:3.0:1762166756.915346:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc70b4c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cd1ae6240 00010000:00010000:0.0:1762166756.915352:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000020:00080000:3.0:1762166756.915353:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc70b4a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7c0f600 00000020:00080000:3.0:1762166756.915373:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc70b4900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc5bda800 00010000:00010000:0.0:1762166756.915376:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac000 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:3.0:1762166756.915378:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].18 00010000:00010000:0.0:1762166756.915383:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.915393:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.915413:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x13:0x0].0x0 (ffff945cc9b89000) 00010000:00010000:0.0:1762166756.915417:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166756.915422:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 41 committed batchid 40 00010000:00010000:0.0:1762166756.915423:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.915433:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ab5b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.915469:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446776576:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166756.915517:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0abd9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c1 expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1762166756.915519:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 40 00010000:00010000:0.0:1762166756.915536:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.915545:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166756.915551:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.915559:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.915560:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.915568:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166756.915582:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446776576 00010000:00010000:1.0:1762166756.915587:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0abd2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c1 expref: 16 pid: 7432 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1762166756.915593:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cadc00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166756.915594:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446776576 00000100:00100000:2.0:1762166756.915599:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1762166756.915601:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.915611:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.915613:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0abd9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c1 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166756.915614:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446776704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166756.915649:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00010000:00010000:0.0:1762166756.915657:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00000100:00100000:3.0:1762166756.915663:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3635:x1847765446776576:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166756.915666:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166756.915669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166756.915676:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166756.915678:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.915680:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166756.915684:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a800, rc 0) 00010000:00010000:0.0:1762166756.915691:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0ab70 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00002000:00080000:3.0:1762166756.915692:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:58 count 1 00000100:00100000:2.0:1762166756.915707:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446776448:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1762166756.915728:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166756.915732:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166756.915738:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166756.915742:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166756.915744:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.915755:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37513:x1847765439985024:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1867us (1966us total) trans 4294968816 rc 0/0 00000100:00100000:2.0:1762166756.915764:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762166756.915779:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446776832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166756.915789:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2486 00010000:00010000:3.0:1762166756.915791:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.915791:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166756.915797:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166756.915801:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166756.915805:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.915807:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.915810:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166756.915827:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166756.915833:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166756.915838:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166756.915845:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166756.915848:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166756.915848:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446776704 00010000:00010000:0.0:1762166756.915849:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166756.915855:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446776704 00010000:00010000:0.0:1762166756.915867:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0abcb lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166756.915869:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166756.915893:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762166756.915894:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446776448 00000100:00100000:2.0:1762166756.915900:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446776448 00000100:00100000:0.0:1762166756.915911:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446776832 00000100:00100000:0.0:1762166756.915917:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446776832 00000100:00100000:1.0:1762166756.915922:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1762166756.915941:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446776704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166756.915948:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1762166756.915955:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1762166756.915956:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446776448:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166756.915966:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3634:x1847765446776832:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:2.0:1762166756.915972:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:61 count 1 00002000:00010000:2.0:1762166756.916011:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166756.916018:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.916028:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.916030:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.916034:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.916043:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.916052:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.916071:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.916090:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1762166756.916091:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:0.0:1762166756.916095:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb mtime from disk: 1762166757 -> 1762166757 00002000:00010000:0.0:1762166756.916097:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb atime from disk: 1762166757 -> 1762166757 00002000:00010000:0.0:1762166756.916098:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb ctime from disk: 1762166757 -> 1762166757 00002000:00010000:0.0:1762166756.916100:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1762166756.916157:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3635:x1847765446776704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (489us total) trans 21474836641 rc 0/0 00000100:00100000:0.0:1762166756.916169:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3634:x1847765446776832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 200us (355us total) trans 17179869323 rc 0/0 00000100:00100000:3.0:1762166756.916170:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3635:x1847765446776576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 501us (618us total) trans 17179869322 rc 0/0 00000100:00100000:1.0:1762166756.916184:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1762166756.916191:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1762166756.916202:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00010000:00010000:1.0:1762166756.916223:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762166756.916230:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.916238:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166756.916242:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.916249:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166756.916262:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db4700/2, rc 0, transno 17179869323 00010000:00010000:1.0:1762166756.916264:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166756.916280:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446776448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 317us (531us total) trans 21474836642 rc 0/0 00000100:00100000:0.0:1762166756.916281:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446776832:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166756.916283:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0abe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166756.916314:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc558bb80/2, rc 0, transno 21474836642 00000100:00100000:2.0:1762166756.916320:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1762166756.916323:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446776448:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1762166756.916329:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166756.916336:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.916352:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9e400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166756.916355:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.916364:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.916368:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166756.916380:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.916388:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9e400/0x2f180c4effb0abe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166756.916391:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4530700/2, rc 0, transno 21474836641 00000100:00100000:2.0:1762166756.916404:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446776704:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762166756.916430:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5804380/2, rc 0, transno 17179869322 00010000:00010000:1.0:1762166756.916433:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166756.916434:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446776576:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166756.916439:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166756.916443:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166756.918080:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.918123:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439985152 00000100:00100000:2.0:1762166756.918130:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439985152 00000100:00100000:2.0:1762166756.918167:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 889 00000100:00100000:2.0:1762166756.918177:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:37513:x1847765439985152:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1762166756.918191:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166756.918203:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75c8 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.918224:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 12 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.918232:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.918234:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.918247:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 12 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.918276:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 12 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166756.918287:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 12 pid: 8383 timeout: 476 lvb_type: 1 00000100:00100000:2.0:1762166756.918297:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446776960:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166756.918360:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166756.919137:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446776960:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166756.919154:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 12 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.919165:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9e800, rc 0) 00000100:00100000:2.0:1762166756.919201:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:37513:x1847765439985152:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1026us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.919209:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 889 00000100:00100000:3.0:1762166756.919368:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.919411:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439985280 00000100:00100000:2.0:1762166756.919416:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439985280 00010000:00010000:2.0:1762166756.919434:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 12 pid: 8383 timeout: 476 lvb_type: 1 00000100:00100000:2.0:1762166756.919461:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 577 00000100:00100000:2.0:1762166756.919468:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:2419:x1847765439985280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.919517:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.919523:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 12 pid: 8383 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.919534:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 12 pid: 8383 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.919550:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ab23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7590 expref: 12 pid: 8383 timeout: 476 lvb_type: 1 00010000:00010000:2.0:1762166756.919560:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.919562:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166756.919566:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 11 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.919575:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 11 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166756.919595:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 11 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166756.919604:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446777088:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166756.919643:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166756.920405:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446777088:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166756.920417:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166756.920452:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2419:x1847765439985280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 981us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.920467:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 577 00000100:00100000:3.0:1762166756.920654:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.920690:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439985408 00000100:00100000:0.0:1762166756.920696:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439985408 00002000:00010000:0.0:1762166756.920719:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/59 (0->18446744073709551615) 00002000:00100000:0.0:1762166756.920724:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011180 with x1847765439985408 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166756.920730:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011180. 00000100:00100000:0.0:1762166756.920755:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 432 00000100:00100000:0.0:1762166756.920764:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2418:x1847765439985408:12345-192.168.204.38@tcp:10:bash.0 00002000:00010000:0.0:1762166756.920971:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb size from disk: 4 -> 0 00002000:00010000:0.0:1762166756.920975:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb mtime from disk: 1762166757 -> 1762166757 00002000:00010000:0.0:1762166756.920977:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb atime from disk: 1762166757 -> 1762166757 00002000:00010000:0.0:1762166756.920980:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb ctime from disk: 1762166757 -> 1762166757 00002000:00010000:0.0:1762166756.920982:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1762166756.921035:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:2418:x1847765439985408:12345-192.168.204.38@tcp:10:bash.0 Request processed in 272us (380us total) trans 17179869324 rc 0/0 00000100:00100000:0.0:1762166756.921042:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 432 00002000:00010000:0.0:1762166756.921046:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/59 (0->18446744073709551615) 00002000:00100000:0.0:1762166756.921049:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011180 with x1847765439985408 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166756.921054:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011180. 00000100:00100000:3.0:1762166756.922614:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.922673:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439985664 00000100:00100000:1.0:1762166756.922686:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439985664 00000100:00100000:1.0:1762166756.922746:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 707 00000100:00100000:1.0:1762166756.922760:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37513:x1847765439985664:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:1.0:1762166756.923105:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37513:x1847765439985664:12345-192.168.204.38@tcp:35:bash.0 Request processed in 349us (491us total) trans 4294968817 rc 0/0 00000100:00100000:1.0:1762166756.923114:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 707 00000100:00100000:3.0:1762166756.931642:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.931715:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439985920 00000100:00100000:1.0:1762166756.931732:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439985920 00000100:00100000:1.0:1762166756.931827:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2487 00000100:00100000:1.0:1762166756.931856:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37664:x1847765439985920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.931888:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.931914:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0abf5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75cf expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.932037:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932052:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932066:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932078:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932082:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932086:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932175:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932183:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932188:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932195:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932211:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.932216:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932224:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932237:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.932240:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.932245:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932250:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0abfc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932262:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932265:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932269:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932272:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.932273:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932276:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932286:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd0738300) 00010000:00010000:1.0:1762166756.932290:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.932296:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932300:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac03 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.932335:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0abf5 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75cf expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.932345:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.932348:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166756.932352:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0abf5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75cf expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.932362:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b600, rc 0) 00000100:00100000:1.0:1762166756.932436:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37664:x1847765439985920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 585us (803us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166756.932442:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2487 00000100:00100000:0.0:1762166756.933740:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.933785:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439986176 00000100:00100000:1.0:1762166756.933794:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439986176 00000100:00100000:1.0:1762166756.933841:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2488 00000100:00100000:1.0:1762166756.933851:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37664:x1847765439986176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.933868:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.933882:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75d6 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166756.933955:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x11:0x0]: returning size 4096 00010000:00010000:1.0:1762166756.934074:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75d6 expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.934101:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166756.934104:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166756.934109:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75d6 expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.934122:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ae00, rc 0) 00000100:00100000:1.0:1762166756.934174:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37664:x1847765439986176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 325us (438us total) trans 4294968818 rc 301/301 00000100:00100000:1.0:1762166756.934179:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2488 00000100:00100000:3.0:1762166756.935019:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.935063:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439986304 00000100:00100000:1.0:1762166756.935070:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439986304 00000100:00100000:1.0:1762166756.935108:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2489 00000100:00100000:1.0:1762166756.935118:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37664:x1847765439986304:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166756.935164:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935175:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935182:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935192:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935196:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935200:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935255:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935261:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935265:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.935287:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166756.935291:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.935299:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935308:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935313:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935317:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935323:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935329:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.935332:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935339:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935348:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.935356:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.935361:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935367:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac18 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935378:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935384:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935390:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935396:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.935399:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935404:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935409:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd0738e00) 00010000:00010000:1.0:1762166756.935411:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.935412:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935416:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935426:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935431:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935443:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935448:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.935450:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935456:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935465:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.935467:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.935470:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.935503:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac26 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.935556:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37664:x1847765439986304:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 440us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.935561:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2489 00000100:00100000:3.0:1762166756.936531:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.936581:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439986560 00000100:00100000:1.0:1762166756.936588:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439986560 00000100:00100000:1.0:1762166756.936626:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 708 00000100:00100000:1.0:1762166756.936635:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37664:x1847765439986560:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166756.936778:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37664:x1847765439986560:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 145us (251us total) trans 4294968819 rc 0/0 00000100:00100000:1.0:1762166756.936783:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 708 00000100:00100000:0.0:1762166756.943406:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.943455:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439986816 00000100:00100000:1.0:1762166756.943498:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439986816 00000100:00100000:1.0:1762166756.943556:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2490 00000100:00100000:1.0:1762166756.943564:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37666:x1847765439986816:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:1.0:1762166756.943589:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.943608:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac2d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75dd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.943679:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943690:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943698:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943709:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943713:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943717:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943817:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943825:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943830:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.943852:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166756.943936:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943942:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943946:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943950:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943953:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.943957:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943962:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943972:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.943974:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.943977:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.943981:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac34 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.944005:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.944008:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.944025:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.944030:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.944032:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.944036:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.944041:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd0738e00) 00010000:00010000:1.0:1762166756.944042:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.944044:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.944047:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac3b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.944081:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac2d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 19 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.944090:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.944095:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.944096:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166756.944098:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b600, rc 0) 00000100:00100000:1.0:1762166756.944151:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37666:x1847765439986816:12345-192.168.204.38@tcp:101:cat.0 Request processed in 589us (758us total) trans 4294968820 rc 0/0 00000100:00100000:1.0:1762166756.944156:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2490 00000100:00100000:3.0:1762166756.945874:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.945917:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439987072 00000100:00100000:1.0:1762166756.945923:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439987072 00000100:00100000:1.0:1762166756.945956:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 709 00000100:00100000:1.0:1762166756.945965:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37666:x1847765439987072:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:1.0:1762166756.946156:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37666:x1847765439987072:12345-192.168.204.38@tcp:35:cat.0 Request processed in 194us (285us total) trans 4294968821 rc 0/0 00000100:00100000:1.0:1762166756.946161:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 709 00000100:00100000:3.0:1762166756.955867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.955966:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439987328 00000100:00100000:1.0:1762166756.955983:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439987328 00000100:00100000:1.0:1762166756.956081:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2491 00000100:00100000:1.0:1762166756.956094:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37668:x1847765439987328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.956126:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.956157:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75e4 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.956287:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac57 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.956303:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac57 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.956316:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac57 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.956329:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x11:0x0]: returning size 4096 00010000:00010000:1.0:1762166756.956443:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0ac50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75e4 expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.956464:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac57 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75e4 expref: 21 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.956546:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.956550:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166756.956554:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ae00, rc 0) 00000100:00100000:1.0:1762166756.956627:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37668:x1847765439987328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 536us (766us total) trans 4294968822 rc 0/0 00000100:00100000:1.0:1762166756.956639:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2491 00000100:00100000:0.0:1762166756.957646:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.957677:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439987456 00000100:00100000:1.0:1762166756.957681:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439987456 00000100:00100000:1.0:1762166756.957706:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2492 00000100:00100000:1.0:1762166756.957710:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37668:x1847765439987456:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166756.957747:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957754:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957759:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957770:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957774:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957778:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957836:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957847:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957851:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.957872:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166756.957876:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.957882:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957892:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957896:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957900:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957904:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957908:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.957911:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957917:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957923:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.957925:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.957929:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957941:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac65 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957953:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957959:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957965:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957970:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.957973:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957979:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.957985:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd0738e00) 00010000:00010000:1.0:1762166756.957987:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.957999:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.958005:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.958016:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.958020:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.958032:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.958036:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.958037:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.958040:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.958045:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.958047:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.958049:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.958052:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac73 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.958090:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37668:x1847765439987456:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 379us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.958095:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2492 00000100:00100000:3.0:1762166756.968888:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.968981:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439987584 00000100:00100000:1.0:1762166756.969010:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439987584 00000100:00100000:1.0:1762166756.969083:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2493 00000100:00100000:1.0:1762166756.969092:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37672:x1847765439987584:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166756.969183:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969198:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969226:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969237:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969242:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969246:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969341:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969350:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969356:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.969405:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166756.969411:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.969424:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969438:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969445:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969451:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969468:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969474:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.969527:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969536:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969551:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.969554:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.969559:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969566:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0ac7a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969581:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969588:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969593:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969598:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.969601:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969607:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969625:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd0738e00) 00010000:00010000:1.0:1762166756.969628:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.969632:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969642:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0ac81 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969659:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969664:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969668:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969670:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.969672:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969675:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969679:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.969681:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.969683:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.969686:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ac88 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.969769:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37672:x1847765439987584:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 677us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.969784:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2493 00000100:00100000:3.0:1762166756.981029:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166756.981106:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439987712 00000100:00100000:0.0:1762166756.981119:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439987712 00000100:00100000:0.0:1762166756.981169:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2494 00000100:00100000:0.0:1762166756.981180:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37675:x1847765439987712:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166756.981243:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981255:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981263:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981272:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981277:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981280:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981348:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981354:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981362:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166756.981393:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:0.0:1762166756.981396:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166756.981404:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981414:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981419:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981424:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981428:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981432:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166756.981435:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981439:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981448:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:0.0:1762166756.981455:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166756.981459:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981463:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0ac8f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981472:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981527:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981531:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981535:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166756.981539:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981544:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981558:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945bc403a700) 00010000:00010000:0.0:1762166756.981559:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166756.981561:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981565:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0ac96 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981576:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981581:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981592:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981598:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166756.981600:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981606:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981614:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166756.981617:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166756.981619:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166756.981624:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0ac9d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166756.981699:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37675:x1847765439987712:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 516us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166756.981712:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2494 00000100:00100000:0.0:1762166756.987874:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.987928:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439987840 00000100:00100000:1.0:1762166756.987940:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439987840 00000100:00100000:1.0:1762166756.988007:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2495 00000100:00100000:1.0:1762166756.988020:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37677:x1847765439987840:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166756.988112:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988131:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988145:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988162:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988169:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988177:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988257:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988264:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988269:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.988305:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166756.988321:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166756.988331:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988343:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988348:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988352:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988356:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988360:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.988363:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988368:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988377:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166756.988379:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.988381:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988385:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aca4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988394:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988398:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988409:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988412:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.988414:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988417:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988421:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd0738e00) 00010000:00010000:1.0:1762166756.988422:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.988423:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988426:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988436:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988439:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988442:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988444:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166756.988446:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988449:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988458:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.988460:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166756.988462:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.988465:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acb2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166756.988566:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37677:x1847765439987840:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 549us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166756.988575:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2495 00000100:00100000:3.0:1762166756.994231:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.994277:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439988096 00000100:00100000:1.0:1762166756.994288:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439988096 00000100:00100000:1.0:1762166756.994354:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2496 00000100:00100000:1.0:1762166756.994367:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:37678:x1847765439988096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.994392:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.994416:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0acb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75eb expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.994579:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0acc0 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.994590:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0acc0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.994601:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0acc0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.994613:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166756.994727:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0acb9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75eb expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.994747:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0acc0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75eb expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.994756:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.994759:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166756.994763:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:1.0:1762166756.994841:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37678:x1847765439988096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 478us (619us total) trans 4294968823 rc 0/0 00000100:00100000:1.0:1762166756.994849:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2496 00000100:00100000:3.0:1762166756.996841:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.996883:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439988352 00000100:00100000:1.0:1762166756.996888:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439988352 00000100:00100000:1.0:1762166756.996917:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2497 00000100:00100000:1.0:1762166756.996923:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37678:x1847765439988352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.996938:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.996947:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acce lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75f2 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.997015:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.997025:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.997031:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.997061:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.997086:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 24 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166756.997103:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446777216:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166756.997196:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166756.997885:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446777216:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166756.997900:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166756.998112:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166756.998153:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439988480 00000100:00100000:2.0:1762166756.998158:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439988480 00010000:00010000:2.0:1762166756.998179:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 25 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166756.998204:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 578 00000100:00100000:2.0:1762166756.998209:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2419:x1847765439988480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166756.998219:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166756.998224:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 25 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.998234:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 25 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.998247:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0ac42 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75dd expref: 25 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166756.998257:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166756.998259:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.998265:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.998269:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166756.998284:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166756.998300:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.998306:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166756.998315:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000100:00100000:2.0:1762166756.998320:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:2419:x1847765439988480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166756.998325:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 578 00010000:00010000:1.0:1762166756.998403:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0acce lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.998417:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.998424:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166756.998426:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166756.998429:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b000, rc 0) 00000100:00100000:1.0:1762166756.998462:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37678:x1847765439988352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1538us (1661us total) trans 4294968824 rc 0/0 00000100:00100000:1.0:1762166756.998469:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2497 00000100:00100000:3.0:1762166756.999341:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166756.999381:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439988608 00000100:00100000:1.0:1762166756.999387:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439988608 00000100:00100000:1.0:1762166756.999421:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2498 00000100:00100000:1.0:1762166756.999430:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37678:x1847765439988608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166756.999446:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166756.999463:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ace3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b75f9 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.999545:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.999554:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.999560:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 4/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166756.999583:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166756.999594:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 25 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166756.999605:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446777344:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166756.999657:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166757.000327:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446777344:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166757.000338:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166757.000549:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.000585:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439988736 00000100:00100000:2.0:1762166757.000592:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439988736 00010000:00010000:2.0:1762166757.000614:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 26 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.000644:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 579 00000100:00100000:2.0:1762166757.000653:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:2418:x1847765439988736:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166757.000664:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166757.000671:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 26 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.000682:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 26 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.000699:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b000/0x2f180c4effb0acd5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f2 expref: 26 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.000712:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166757.000716:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166757.000724:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166757.000731:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166757.000768:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166757.000795:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166757.000807:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2418:x1847765439988736:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 153us (256us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166757.000809:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166757.000828:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 579 00000004:00200000:1.0:1762166757.000844:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166757.000848:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166757.000862:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.000879:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0ace3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f9 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.000888:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f9 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.000893:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.000895:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166757.000897:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00000100:00100000:1.0:1762166757.000923:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37678:x1847765439988608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1495us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166757.000927:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2498 00000100:00100000:3.0:1762166757.002124:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.002160:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439988992 00000100:00100000:1.0:1762166757.002165:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439988992 00000100:00100000:1.0:1762166757.002195:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 710 00000100:00100000:1.0:1762166757.002201:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37678:x1847765439988992:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166757.002338:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37678:x1847765439988992:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 136us (216us total) trans 4294968825 rc 0/0 00000100:00100000:1.0:1762166757.002346:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 710 00000100:00100000:0.0:1762166757.003153:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.003198:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439989248 00000100:00100000:1.0:1762166757.003214:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439989248 00000100:00100000:1.0:1762166757.003249:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2499 00000100:00100000:1.0:1762166757.003257:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37678:x1847765439989248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.003273:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.003276:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166757.003295:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0acc0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75eb expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.003306:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.003308:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166757.003317:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0acf1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7600 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.003375:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0acf8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.003387:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0acf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.003394:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0acf8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166757.003405:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166757.003463:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0acf1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7600 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.003495:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0acf8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7600 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.003504:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.003506:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166757.003513:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cadc00, rc 0) 00000100:00100000:1.0:1762166757.003550:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:37678:x1847765439989248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 295us (400us total) trans 4294968826 rc 0/0 00000100:00100000:1.0:1762166757.003555:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2499 00000100:00100000:3.0:1762166757.004342:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.004377:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439989376 00000100:00100000:2.0:1762166757.004382:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439989376 00000100:00100000:2.0:1762166757.004418:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 890 00000100:00100000:2.0:1762166757.004426:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:2418:x1847765439989376:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166757.004459:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.004501:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 12 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.004508:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166757.004511:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166757.004513:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.004542:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 12 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.004552:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 12 pid: 8383 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.004565:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446777472:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166757.004623:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166757.005225:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446777472:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166757.005244:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166757.005432:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.005501:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439989504 00000100:00100000:0.0:1762166757.005506:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439989504 00002000:00100000:0.0:1762166757.005539:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x3b:0x0] (0->3) req@ffff945bc95b2a00 x1847765439989504/t0(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:543/0 lens 496/0 e 0 to 0 dl 1762166768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166757.005550:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc95b2a00 with x1847765439989504 ext(0->3) 00010000:00010000:0.0:1762166757.005558:0:23943:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 13 pid: 8383 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1762166757.005583:0:23943:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 13 pid: 8383 timeout: 476 lvb_type: 0 00002000:00010000:0.0:1762166757.005589:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945bc95b2a00 00000100:00100000:0.0:1762166757.005609:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:0.0:1762166757.005615:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2418:x1847765439989504:12345-192.168.204.38@tcp:4:cat.0 00000100:00100000:0.0:1762166757.006206:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2418:x1847765439989504:12345-192.168.204.38@tcp:4:cat.0 Request processed in 590us (773us total) trans 17179869325 rc 0/0 00000100:00100000:0.0:1762166757.006215:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00002000:00100000:0.0:1762166757.006224:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x3b:0x0] (0->3) req@ffff945bc95b2a00 x1847765439989504/t17179869325(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:543/0 lens 496/448 e 0 to 0 dl 1762166768 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166757.006232:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc95b2a00 with x1847765439989504 ext(0->3) 00010000:00010000:0.0:1762166757.006237:0:23943:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 15 pid: 8383 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1762166757.006251:0:23943:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 15 pid: 8383 timeout: 476 lvb_type: 0 00002000:00010000:0.0:1762166757.006259:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945bc95b2a00 00000100:00100000:3.0:1762166757.006898:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.006935:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439989632 00000100:00100000:2.0:1762166757.006941:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439989632 00010000:00010000:2.0:1762166757.006963:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 15 pid: 8383 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.007008:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 580 00000100:00100000:2.0:1762166757.007017:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2419:x1847765439989632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166757.007029:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1762166757.007043:0:8398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb size from disk: 0 -> 4 00002000:00010000:2.0:1762166757.007047:0:8398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1762166757.007053:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 15 pid: 8383 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.007066:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 15 pid: 8383 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.007087:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0abee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c8 expref: 15 pid: 8383 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.007101:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.007103:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.007114:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.007125:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.007156:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166757.007183:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166757.007189:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2419:x1847765439989632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (289us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166757.007194:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166757.007203:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 580 00010000:00010000:0.0:1762166757.007221:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.007227:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.007232:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.007237:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9ec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166757.007241:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.007246:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.007256:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.007267:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9ec00/0x2f180c4effb0ad06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166757.007316:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2418:x1847765439989376:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2890us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166757.007325:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 890 00000100:00100000:3.0:1762166757.008004:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.008038:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439989888 00000100:00100000:1.0:1762166757.008042:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439989888 00000100:00100000:1.0:1762166757.008071:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2500 00000100:00100000:1.0:1762166757.008077:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:37678:x1847765439989888:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166757.008115:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166757.008127:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0abd9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75c1 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.008140:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0acea lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75f9 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.008147:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.008150:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166757.008167:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.008175:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.008180:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:1.0:1762166757.008344:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].97, 88 off16080 00000004:00080000:1.0:1762166757.008352:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376156873419ns, next at 376358321105ns, rc = 0 00000040:00080000:1.0:1762166757.008533:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].102, 88 off16472 00000004:00080000:1.0:1762166757.008540:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376157062251ns, next at 376358357885ns, rc = 0 00000001:00080000:0.0:1762166757.009360:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968827 is committed 00000004:00080000:0.0:1762166757.009369:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 96 committed 00000004:00080000:0.0:1762166757.009380:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 89 committed 00000020:00080000:0.0:1762166757.009400:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 41 batchid updated 00000020:00080000:1.0:1762166757.009441:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 41 00000100:00100000:0.0:1762166757.009496:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446777728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166757.009513:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1762166757.009528:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446777600:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1762166757.009542:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 41 cancel update log [0x200000400:0x2:0x0].18: rc = 0 00000100:00100000:0.0:1762166757.009550:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762166757.009555:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 41 00000004:00010000:1.0:1762166757.009584:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000551319e6 reply state 000000007c0ba403 transno 4294968827 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166757.009596:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166757.009599:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.009606:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.009608:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166757.009611:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166757.009618:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446777728 00000100:00100000:3.0:1762166757.009625:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446777728 00000100:00100000:2.0:1762166757.009637:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446777600 00000100:00100000:2.0:1762166757.009643:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446777600 00000100:00100000:3.0:1762166757.009666:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:3.0:1762166757.009677:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446777728:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:1.0:1762166757.009678:0:7432:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762166757.009683:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1762166757.009694:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37678:x1847765439989888:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1615us (1701us total) trans 4294968827 rc 0/0 00000100:00100000:2.0:1762166757.009696:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3636:x1847765446777600:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166757.009703:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166757.009707:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2500 00010000:00010000:0.0:1762166757.009715:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166757.009720:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166757.009723:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166757.009727:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166757.009732:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166757.009739:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166757.009741:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166757.009743:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166757.009748:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ad0d lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166757.009795:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765446777728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (246us total) trans 21474836643 rc 0/0 00000100:00100000:3.0:1762166757.009810:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000004:00080000:0.0:1762166757.009812:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc95b3800/2, rc 0, transno 21474836643 00000100:00100000:0.0:1762166757.009820:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446777728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166757.009837:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3636:x1847765446777600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (243us total) trans 17179869326 rc 0/0 00000100:00100000:2.0:1762166757.009846:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000004:00080000:1.0:1762166757.009857:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef7b80/2, rc 0, transno 17179869326 00000100:00100000:1.0:1762166757.009863:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446777600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166757.010622:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.010664:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439990016 00000100:00100000:1.0:1762166757.010670:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439990016 00000100:00100000:1.0:1762166757.010705:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2501 00000100:00100000:1.0:1762166757.010714:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37678:x1847765439990016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.010728:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.010741:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7607 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.010776:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.010800:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.010818:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.010821:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166757.010823:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac000, rc 0) 00000100:00100000:1.0:1762166757.010861:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37678:x1847765439990016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 148us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166757.010868:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2501 00000100:00100000:3.0:1762166757.011818:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.011854:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439990144 00000100:00100000:1.0:1762166757.011859:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439990144 00000100:00100000:1.0:1762166757.011884:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2502 00000100:00100000:1.0:1762166757.011890:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37678:x1847765439990144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.011898:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.011906:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad1b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b760e expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.011972:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0ad22 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.011979:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0ad22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.011984:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0ad22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166757.012013:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:1.0:1762166757.012017:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166757.012037:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0ad22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166757.012057:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad1b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b760e expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.012066:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0ad22 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b760e expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.012070:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.012072:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166757.012074:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cacc00, rc 0) 00000100:00100000:1.0:1762166757.012100:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37678:x1847765439990144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 211us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166757.012105:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2502 00000100:00100000:3.0:1762166757.012914:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.012952:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439990272 00000100:00100000:2.0:1762166757.012957:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439990272 00000100:00100000:2.0:1762166757.013004:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 893 00000100:00100000:2.0:1762166757.013014:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765439990272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166757.013026:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166757.013038:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0ad29 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7615 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166757.013071:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 4, mtime: 0x690887e5, atime: 0x690887e5, ctime: 0x690887e5, blocks: 0x8 00010000:00010000:2.0:1762166757.013086:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.013088:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.013095:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0ad29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7615 expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166757.013109:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0ad29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7615 expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166757.013119:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9f200, rc 0) 00000100:00100000:2.0:1762166757.013155:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2419:x1847765439990272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 143us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.013161:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 893 00000100:00100000:3.0:1762166757.034211:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.034301:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439990400 00000100:00100000:2.0:1762166757.034316:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439990400 00000100:00100000:2.0:1762166757.034394:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 894 00000100:00100000:2.0:1762166757.034409:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439990400:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166757.034599:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439990400:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 194us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.034609:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 894 00000100:00100000:3.0:1762166757.035751:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.035803:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439990528 00000100:00100000:2.0:1762166757.035810:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439990528 00000100:00100000:2.0:1762166757.035848:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 895 00000100:00100000:2.0:1762166757.035857:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2419:x1847765439990528:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166757.035937:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2419:x1847765439990528:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.035962:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 895 00000100:00100000:3.0:1762166757.037560:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.037613:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439990656 00000100:00100000:2.0:1762166757.037622:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439990656 00000100:00100000:2.0:1762166757.037687:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 433 00000100:00100000:2.0:1762166757.037697:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439990656:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166757.037739:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037754:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.037755:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.037761:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037773:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037877:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037883:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037889:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037895:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9e800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166757.037899:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037924:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037941:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.037948:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9e800/0x2f180c4effb0ad30 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166757.038021:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439990656:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 326us (470us total) trans 0 rc 4/4 00000100:00100000:2.0:1762166757.038029:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 433 00000100:00100000:3.0:1762166757.039803:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.039856:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439990784 00000100:00100000:2.0:1762166757.039867:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439990784 00000100:00100000:2.0:1762166757.039933:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 434 00000100:00100000:2.0:1762166757.039944:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765439990784:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166757.040002:0:23943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 4, mtime: 0x690887e5, atime: 0x690887e5, ctime: 0x690887e5, blocks: 0x8 00010000:00010000:2.0:1762166757.040013:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.040026:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.040028:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.040033:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.040046:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166757.041207:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836644 is committed 00000001:00080000:1.0:1762166757.041220:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836643 is committed 00002000:00010000:2.0:1762166757.041289:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb size from disk: 4 -> 4096 00010000:00010000:2.0:1762166757.041303:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.041315:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.041324:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.041331:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9f800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166757.041345:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.041356:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.041371:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.041376:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f800/0x2f180c4effb0ad37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166757.041462:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2418:x1847765439990784:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1519us (1666us total) trans 21474836644 rc 0/0 00000100:00100000:2.0:1762166757.041472:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 434 00000100:00100000:3.0:1762166757.049326:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.049404:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439991040 00000100:00100000:1.0:1762166757.049418:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439991040 00000100:00100000:3.0:1762166757.049507:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2503 00000100:00100000:3.0:1762166757.049522:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:37678:x1847765439991040:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166757.049587:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166757.049618:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0ad22 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b760e expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.049638:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:3.0:1762166757.049642:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166757.049857:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.049874:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.049885:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000001:00080000:3.0:1762166757.049938:0:12357:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968828 00000004:00010000:3.0:1762166757.049965:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000019ef5234 reply state 000000008bfe0a65 transno 4294968829 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.050006:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.050011:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:3.0:1762166757.050013:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166757.050015:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166757.050107:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37678:x1847765439991040:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 590us (794us total) trans 4294968829 rc 0/0 00000100:00100000:3.0:1762166757.050113:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2503 00000020:00080000:3.0:1762166757.050118:0:12357:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166757.051118:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.051170:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439991168 00000100:00100000:2.0:1762166757.051187:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439991168 00000100:00100000:2.0:1762166757.051227:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 896 00000100:00100000:2.0:1762166757.051234:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:37678:x1847765439991168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166757.051248:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166757.051264:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9fa00/0x2f180c4effb0ad45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b761c expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166757.051293:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 4096, mtime: 0x690887e5, atime: 0x690887e5, ctime: 0x690887e5, blocks: 0x8 00010000:00010000:2.0:1762166757.051315:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.051317:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.051325:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9fa00/0x2f180c4effb0ad45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b761c expref: 8 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.051342:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9fa00/0x2f180c4effb0ad45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b761c expref: 8 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.051355:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9fa00, rc 0) 00000100:00100000:2.0:1762166757.051403:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:37678:x1847765439991168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 169us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.051411:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 896 00000100:00100000:0.0:1762166757.052471:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.052570:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439991296 00000100:00100000:2.0:1762166757.052580:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439991296 00002000:00010000:2.0:1762166757.052614:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/62 (4->18446744073709551615) 00002000:00100000:2.0:1762166757.052619:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d500 with x1847765439991296 ext(4->18446744073709551615) 00002000:00010000:2.0:1762166757.052629:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406d500. 00000100:00100000:2.0:1762166757.052653:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 435 00000100:00100000:2.0:1762166757.052660:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765439991296:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166757.052965:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb size from disk: 4096 -> 4 00002000:00010000:2.0:1762166757.052968:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb mtime from disk: 1762166757 -> 1762166757 00002000:00010000:2.0:1762166757.052970:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb atime from disk: 1762166757 -> 1762166757 00002000:00010000:2.0:1762166757.052972:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb ctime from disk: 1762166757 -> 1762166757 00002000:00010000:2.0:1762166757.052974:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1762166757.053028:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765439991296:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 368us (566us total) trans 21474836645 rc 0/0 00000100:00100000:2.0:1762166757.053033:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 435 00002000:00010000:2.0:1762166757.053035:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/62 (4->18446744073709551615) 00002000:00100000:2.0:1762166757.053037:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d500 with x1847765439991296 ext(4->18446744073709551615) 00002000:00010000:2.0:1762166757.053041:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406d500. 00000100:00100000:3.0:1762166757.054095:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.054156:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439991552 00000100:00100000:1.0:1762166757.054163:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439991552 00000100:00100000:1.0:1762166757.054218:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2504 00000100:00100000:1.0:1762166757.054225:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37678:x1847765439991552:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166757.054336:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.054352:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.054365:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00010000:1.0:1762166757.054505:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000020c04e54 reply state 00000000af22506f transno 4294968830 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.054520:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.054527:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.054529:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166757.054532:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166757.054601:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:37678:x1847765439991552:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 377us (508us total) trans 4294968830 rc 0/0 00000100:00100000:1.0:1762166757.054606:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2504 00000100:00100000:3.0:1762166757.055464:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.055527:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439991680 00000100:00100000:2.0:1762166757.055533:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439991680 00000100:00100000:2.0:1762166757.055569:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 897 00000100:00100000:2.0:1762166757.055575:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2419:x1847765439991680:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166757.055712:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:2.0:1762166757.055716:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb mtime from disk: 1762166757 -> 1762166757 00002000:00010000:2.0:1762166757.055718:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb atime from disk: 1762166757 -> 1762166757 00002000:00010000:2.0:1762166757.055721:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb ctime from disk: 1762166757 -> 1762166757 00002000:00010000:2.0:1762166757.055723:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1762166757.055766:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2419:x1847765439991680:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 190us (304us total) trans 17179869327 rc 0/0 00000100:00100000:2.0:1762166757.055772:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 897 00000100:00100000:0.0:1762166757.056657:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.056715:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439991936 00000100:00100000:1.0:1762166757.056721:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439991936 00000100:00100000:1.0:1762166757.056752:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 711 00000100:00100000:1.0:1762166757.056758:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:37678:x1847765439991936:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166757.056802:0:6498:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000403:0x12:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0acf8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7600 expref: 20 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.056844:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166757.056853:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 20 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.056859:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166757.056889:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 20 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.056913:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 20 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166757.056932:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446777856:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166757.057054:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166757.057789:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446777856:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166757.057808:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:0.0:1762166757.057999:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.058048:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439992064 00000100:00100000:2.0:1762166757.058054:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439992064 00010000:00010000:2.0:1762166757.058086:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 21 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.058118:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 581 00000100:00100000:2.0:1762166757.058127:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:2419:x1847765439992064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166757.058140:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166757.058147:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 21 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.058160:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 21 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.058176:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad14 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7607 expref: 21 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.058193:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166757.058197:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.058206:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.058214:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.058238:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166757.058273:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:2419:x1847765439992064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 147us (284us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166757.058276:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166757.058287:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 581 00010000:00010000:1.0:1762166757.058293:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000040:00080000:1.0:1762166757.058581:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].98, 88 off16168 00000004:00080000:1.0:1762166757.058590:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376207112011ns, next at 376358321105ns, rc = 0 00000040:00080000:1.0:1762166757.058632:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].103, 88 off16560 00000004:00080000:1.0:1762166757.058638:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376207160359ns, next at 376358357885ns, rc = 0 00000001:00080000:0.0:1762166757.059586:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968831 is committed 00000004:00080000:0.0:1762166757.059594:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 97 committed 00000004:00080000:0.0:1762166757.059606:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 90 committed 00010000:00010000:2.0:1762166757.059613:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.059630:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.059638:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.059644:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.059650:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.059659:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00000004:00010000:0.0:1762166757.059670:0:6498:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a4afe069 reply state 00000000081647a6 transno 4294968831 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.059673:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166757.059679:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.059686:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166757.059692:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.059695:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ad3e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166757.059708:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166757.059713:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1762166757.059716:0:6498:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166757.059718:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446778112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166757.059720:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446777984:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166757.059721:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.059733:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.059739:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166757.059742:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166757.059748:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166757.059753:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166757.059755:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0acf8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7600 expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.059757:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.059786:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00000100:00100000:3.0:1762166757.059793:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166757.059798:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166757.059801:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.059803:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.059807:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ad4c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:1.0:1762166757.059832:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446778112 00000100:00100000:1.0:1762166757.059837:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446778112 00000100:00100000:3.0:1762166757.059858:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1762166757.059858:0:6498:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166757.059873:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446777984 00000100:00100000:1.0:1762166757.059877:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446777984 00000100:00100000:0.0:1762166757.059879:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37678:x1847765439991936:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3118us (3220us total) trans 4294968831 rc 0/0 00000100:00100000:0.0:1762166757.059890:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 711 00000100:00100000:1.0:1762166757.059907:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1762166757.059916:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1762166757.059917:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446778112:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166757.059918:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.059929:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166757.059932:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3636:x1847765446777984:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166757.059934:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.059943:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3caca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166757.059951:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.059956:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.059963:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166757.059965:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166757.059967:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.059971:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0ad53 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00002000:00010000:1.0:1762166757.060049:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:1.0:1762166757.060057:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb mtime from disk: 1762166757 -> 1762166757 00002000:00010000:1.0:1762166757.060060:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb atime from disk: 1762166757 -> 1762166757 00002000:00010000:1.0:1762166757.060063:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb ctime from disk: 1762166757 -> 1762166757 00002000:00010000:1.0:1762166757.060065:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3e:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:3.0:1762166757.060095:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb size from disk: 4 -> 4 00002000:00010000:3.0:1762166757.060100:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb mtime from disk: 1762166757 -> 1762166757 00002000:00010000:3.0:1762166757.060102:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb atime from disk: 1762166757 -> 1762166757 00002000:00010000:3.0:1762166757.060104:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb ctime from disk: 1762166757 -> 1762166757 00002000:00010000:3.0:1762166757.060107:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1762166757.060113:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446778112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (325us total) trans 21474836646 rc 0/0 00000100:00100000:1.0:1762166757.060120:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1762166757.060144:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836643 gen 2 00000004:00080000:2.0:1762166757.060151:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6fb80, transno 21474836638 00000100:00100000:3.0:1762166757.060158:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3636:x1847765446777984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 231us (300us total) trans 17179869328 rc 0/0 00000100:00100000:3.0:1762166757.060167:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000004:00080000:2.0:1762166757.060167:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836640 committed transno 21474836643 00000004:00080000:2.0:1762166757.060192:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4530700, transno 21474836641 00000004:00080000:0.0:1762166757.060193:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4533b80/2, rc 0, transno 17179869328 00000004:00080000:2.0:1762166757.060200:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc558bb80, transno 21474836642 00000100:00100000:0.0:1762166757.060202:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446777984:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762166757.060207:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc95b3800, transno 21474836643 00000100:00100000:2.0:1762166757.060218:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf79e9f80 x1847765446778112/t21474836646(21474836646) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166773 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166757.060228:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e9f80/2, rc 0, transno 21474836646 00000100:00100000:2.0:1762166757.060233:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446778112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762166757.060275:0:9163:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 3 done 00000100:00100000:0.0:1762166757.060750:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.060795:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439992192 00000100:00100000:1.0:1762166757.060801:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439992192 00000100:00100000:1.0:1762166757.060839:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2505 00000100:00100000:1.0:1762166757.060846:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:37678:x1847765439992192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.060860:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.060873:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7623 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.060909:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.060918:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.060930:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.060932:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166757.060934:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad000, rc 0) 00000100:00100000:1.0:1762166757.060962:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37678:x1847765439992192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 116us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166757.060969:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2505 00000100:00100000:2.0:1762166757.062116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.062157:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439992448 00000100:00100000:0.0:1762166757.062163:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439992448 00000100:00100000:0.0:1762166757.062193:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 712 00000100:00100000:0.0:1762166757.062199:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:37678:x1847765439992448:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166757.062352:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37678:x1847765439992448:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 154us (241us total) trans 4294968832 rc 0/0 00000100:00100000:0.0:1762166757.062357:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 712 00000100:00100000:3.0:1762166757.063396:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.063446:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439992704 00000100:00100000:1.0:1762166757.063452:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439992704 00000100:00100000:1.0:1762166757.063525:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2506 00000100:00100000:1.0:1762166757.063534:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:37678:x1847765439992704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.063550:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.063564:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ad61 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b762a expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.063624:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063636:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063648:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063662:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063669:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063675:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063770:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063776:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063781:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166757.063802:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166757.063857:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063861:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063866:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063869:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166757.063871:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063875:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063884:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166757.063885:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166757.063888:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063892:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0ad68 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063901:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063904:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063907:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063917:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166757.063919:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063923:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063927:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd0738a00) 00010000:00010000:1.0:1762166757.063928:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166757.063929:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063932:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0ad6f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.063961:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0ad61 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 18 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.063969:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.063974:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.063975:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166757.063977:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cade00, rc 0) 00000100:00100000:1.0:1762166757.064029:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37678:x1847765439992704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 497us (639us total) trans 4294968833 rc 0/0 00000100:00100000:1.0:1762166757.064034:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2506 00000100:00100000:3.0:1762166757.065338:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.065390:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439992960 00000100:00100000:0.0:1762166757.065396:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439992960 00000100:00100000:0.0:1762166757.065429:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 713 00000100:00100000:0.0:1762166757.065435:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:37678:x1847765439992960:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166757.065609:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37678:x1847765439992960:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 173us (276us total) trans 4294968834 rc 0/0 00000100:00100000:0.0:1762166757.065630:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 713 00000100:00100000:2.0:1762166757.066665:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.066714:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439993216 00000100:00100000:1.0:1762166757.066720:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439993216 00000100:00100000:1.0:1762166757.066772:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2507 00000100:00100000:1.0:1762166757.066782:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:37678:x1847765439993216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.066800:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.066817:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ad84 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7631 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.066894:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.066908:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 19 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.066916:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.066950:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 19 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.066964:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 19 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166757.066979:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446778240:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166757.067070:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166757.067817:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446778240:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166757.067838:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166757.068072:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166757.068150:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439993344 00000100:00100000:3.0:1762166757.068157:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439993344 00010000:00010000:3.0:1762166757.068185:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 20 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1762166757.068219:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 582 00000100:00100000:3.0:1762166757.068230:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:2418:x1847765439993344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166757.068243:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166757.068249:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 20 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1762166757.068262:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 20 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1762166757.068282:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ad76 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b762a expref: 20 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:3.0:1762166757.068299:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:3.0:1762166757.068303:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.068313:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.068321:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.068346:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166757.068400:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:2418:x1847765439993344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166757.068409:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 582 00010000:00010000:1.0:1762166757.068427:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.068463:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166757.068526:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166757.068640:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0ad84 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7631 expref: 20 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.068656:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7631 expref: 19 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.068662:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.068664:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166757.068666:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac000, rc 0) 00000100:00100000:1.0:1762166757.068716:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37678:x1847765439993216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1935us (2054us total) trans 4294968835 rc 0/0 00000100:00100000:1.0:1762166757.068723:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2507 00000100:00100000:2.0:1762166757.069624:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.069661:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439993472 00000100:00100000:0.0:1762166757.069669:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439993472 00000100:00100000:0.0:1762166757.069703:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 714 00000100:00100000:0.0:1762166757.069710:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37678:x1847765439993472:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166757.069797:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37678:x1847765439993472:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 87us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166757.069802:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 714 00000100:00100000:3.0:1762166757.070718:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.070757:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439993728 00000100:00100000:1.0:1762166757.070762:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439993728 00000100:00100000:1.0:1762166757.070789:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2508 00000100:00100000:1.0:1762166757.070794:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:37678:x1847765439993728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.070806:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.070826:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0ad99 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7638 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.070895:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.070909:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.070927:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.070940:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x11:0x0].0x9da75000 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.070946:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.070953:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071283:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071291:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071298:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166757.071306:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x15:0x0]: returning size 0 00010000:00010000:1.0:1762166757.071322:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071329:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071336:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071341:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166757.071345:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071357:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071364:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166757.071366:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166757.071369:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071372:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0ada0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000004:00010000:1.0:1762166757.071379:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f36a2712 reply state 0000000034fba66c transno 4294968836 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071385:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.071389:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x9da75000 (ffff945cd0738000) 00010000:00010000:1.0:1762166757.071391:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166757.071393:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166757.071411:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0ad99 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 22 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.071423:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.071430:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x15:0x0].0x0 (ffff945cd0738b00) 00010000:00010000:1.0:1762166757.071432:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166757.071435:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00000100:00100000:1.0:1762166757.071499:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:37678:x1847765439993728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 680us (761us total) trans 4294968836 rc 0/0 00000100:00100000:1.0:1762166757.071513:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2508 00000100:00100000:3.0:1762166757.072936:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.072983:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439993984 00000100:00100000:1.0:1762166757.073001:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439993984 00000100:00100000:1.0:1762166757.073042:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2509 00000100:00100000:1.0:1762166757.073051:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:37678:x1847765439993984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.073082:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.073085:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166757.073103:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0ad8b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7631 expref: 22 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.073117:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.073121:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166757.073129:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0adbc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b763f expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.073197:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0adc3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.073207:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0adc3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166757.073214:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0adc3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166757.073222:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:1.0:1762166757.073273:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cadc00/0x2f180c4effb0adbc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b763f expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.073286:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0adc3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b763f expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.073300:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.073303:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166757.073306:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a800, rc 0) 00000100:00100000:1.0:1762166757.073347:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37678:x1847765439993984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 297us (416us total) trans 4294968837 rc 0/0 00000100:00100000:1.0:1762166757.073353:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2509 00000100:00100000:2.0:1762166757.074320:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.074381:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439994240 00000100:00100000:0.0:1762166757.074389:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439994240 00000100:00100000:0.0:1762166757.074432:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 715 00000100:00100000:0.0:1762166757.074442:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37678:x1847765439994240:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166757.074540:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000403:0x12:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0adc3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b763f expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.074575:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.074588:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.074596:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.074601:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.074635:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.074663:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 23 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:0.0:1762166757.074681:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446778368:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166757.074757:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.074764:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 23 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:0.0:1762166757.074770:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446778496:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166757.074790:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166757.075591:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446778368:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166757.075879:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446778496:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166757.075904:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166757.076247:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166757.076294:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.076344:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439994368 00000100:00100000:1.0:1762166757.076352:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439994368 00000100:00100000:2.0:1762166757.076373:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439994496 00010000:00010000:1.0:1762166757.076378:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 24 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.076380:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439994496 00010000:00010000:2.0:1762166757.076418:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 25 pid: 7432 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166757.076421:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 583 00000100:00100000:1.0:1762166757.076434:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2419:x1847765439994368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166757.076449:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166757.076455:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 25 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.076464:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 584 00010000:00010000:1.0:1762166757.076474:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 25 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.076520:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2419:x1847765439994496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166757.076524:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0ad5a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7623 expref: 25 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:1.0:1762166757.076540:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:1.0:1762166757.076545:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.076553:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166757.076564:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 24 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:1.0:1762166757.076566:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166757.076583:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166757.076589:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 24 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.076605:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0abc4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75ba expref: 24 pid: 7432 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.076617:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:2.0:1762166757.076622:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166757.076631:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:2419:x1847765439994368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 198us (425us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166757.076632:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.076646:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166757.076647:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 583 00010000:00010000:2.0:1762166757.076678:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166757.076707:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:2419:x1847765439994496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 232us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.076717:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 584 00010000:00010000:0.0:1762166757.076717:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.076728:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.076751:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.076763:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.076789:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.076821:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.076834:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 21 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:0.0:1762166757.076848:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446778624:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166757.076919:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166757.077726:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446778624:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166757.077743:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166757.077916:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.077954:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439994624 00000100:00100000:2.0:1762166757.077964:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439994624 00010000:00010000:2.0:1762166757.077977:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 22 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.078011:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 585 00000100:00100000:2.0:1762166757.078016:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:2419:x1847765439994624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166757.078024:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166757.078028:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 22 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.078035:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 22 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.078044:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0adae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7638 expref: 22 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.078054:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x15:0x0].0x0 (ffff945cd0738b00) 00010000:00010000:2.0:1762166757.078059:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.078065:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.078071:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166757.078093:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166757.078117:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166757.078125:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:2419:x1847765439994624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 107us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166757.078130:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166757.078133:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 585 00000100:00100000:0.0:1762166757.078392:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446778752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166757.078421:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166757.078442:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d010d19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166757.078457:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446778752 00000100:00100000:2.0:1762166757.078463:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446778752 00000100:00100000:2.0:1762166757.078517:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1762166757.078526:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446778752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166757.078603:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446778752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.078612:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1762166757.078625:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446778752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166757.078654:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968838 00000001:00080000:0.0:1762166757.078681:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968839 00010000:00010000:0.0:1762166757.078699:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078705:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078709:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078712:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166757.078715:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078719:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078725:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x15:0x0].0x0 (ffff945cd0738b00) 00010000:00010000:0.0:1762166757.078727:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166757.078729:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078732:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0add8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x15:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078744:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078747:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078750:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078753:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166757.078755:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078762:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078766:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166757.078768:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166757.078769:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078772:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0add1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166757.078779:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cc9b89a00) 00010000:00010000:0.0:1762166757.078780:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166757.078783:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0adc3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x12:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b763f expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166757.078836:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:37678:x1847765439994240:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4396us (4520us total) trans 4294968840 rc 0/0 00000100:00100000:0.0:1762166757.078844:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 715 00000020:00080000:0.0:1762166757.078847:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166757.079753:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.079783:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439994752 00000100:00100000:1.0:1762166757.079787:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439994752 00000100:00100000:1.0:1762166757.079811:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2510 00000100:00100000:1.0:1762166757.079816:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:37678:x1847765439994752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166757.079826:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166757.079835:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0addf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7646 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.079859:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0addf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7646 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.079866:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0addf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7646 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.079875:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:1.0:1762166757.079877:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166757.079878:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:1.0:1762166757.079904:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37678:x1847765439994752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166757.079911:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2510 00000100:00100000:3.0:1762166757.080906:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.080948:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439995008 00000100:00100000:0.0:1762166757.080953:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439995008 00000100:00100000:0.0:1762166757.080985:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 716 00000100:00100000:0.0:1762166757.081008:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:37678:x1847765439995008:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166757.081159:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37678:x1847765439995008:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 155us (252us total) trans 4294968841 rc 0/0 00000100:00100000:0.0:1762166757.081167:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 716 00000100:00100000:3.0:1762166757.082575:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.082601:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439995264 00000100:00100000:0.0:1762166757.082613:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439995264 00000100:00100000:0.0:1762166757.082642:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 717 00000100:00100000:0.0:1762166757.082648:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:37678:x1847765439995264:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166757.082786:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37678:x1847765439995264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 137us (213us total) trans 4294968842 rc 0/0 00000100:00100000:0.0:1762166757.082794:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 717 00000100:00100000:3.0:1762166757.089507:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.089562:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439995520 00000100:00100000:2.0:1762166757.089571:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439995520 00000100:00100000:2.0:1762166757.089615:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2511 00000100:00100000:2.0:1762166757.089622:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37679:x1847765439995520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166757.089642:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166757.089656:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ade6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b764d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.089708:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089717:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089724:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089733:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089740:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089745:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089822:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089827:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089830:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089834:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9e200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.089836:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089841:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089848:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:2.0:1762166757.089851:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.089853:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089856:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0aded lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089863:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089867:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089870:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089879:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9e000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.089881:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089884:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089888:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cf39a3e00) 00010000:00010000:2.0:1762166757.089889:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.089891:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089894:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0adf4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.089915:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ade6 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b764d expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.089920:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:2.0:1762166757.089922:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166757.089924:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ade6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b764d expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.089928:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9f000, rc 0) 00000100:00100000:2.0:1762166757.089977:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37679:x1847765439995520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 351us (500us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166757.089985:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2511 00000100:00100000:3.0:1762166757.091053:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.091089:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439995648 00000100:00100000:2.0:1762166757.091095:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439995648 00000100:00100000:2.0:1762166757.091132:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2512 00000100:00100000:2.0:1762166757.091140:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37679:x1847765439995648:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166757.091180:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091190:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091198:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091208:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091214:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091220:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091256:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091264:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091271:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166757.091306:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:2.0:1762166757.091310:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166757.091321:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091331:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091342:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091348:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091354:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9f400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.091357:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091363:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091371:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:2.0:1762166757.091374:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.091377:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091383:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0adfb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091392:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091398:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091404:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091408:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9fe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.091411:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091425:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091433:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cf39a3200) 00010000:00010000:2.0:1762166757.091435:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.091438:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091443:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae02 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091455:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091460:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091465:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091470:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9ee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.091473:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091501:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091508:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:2.0:1762166757.091511:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.091513:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.091520:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae09 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166757.091572:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37679:x1847765439995648:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 432us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.091579:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2512 00000100:00100000:3.0:1762166757.099228:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.099281:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439995904 00000100:00100000:2.0:1762166757.099289:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439995904 00000100:00100000:2.0:1762166757.099349:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2513 00000100:00100000:2.0:1762166757.099361:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:37680:x1847765439995904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166757.099387:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166757.099406:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae10 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7654 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.099502:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099514:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099520:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099530:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099534:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099538:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099617:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099632:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099637:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166757.099645:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:2.0:1762166757.099708:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099713:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099717:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099720:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9e000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.099723:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099727:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099735:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:2.0:1762166757.099737:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.099740:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099743:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e000/0x2f180c4effb0ae17 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099750:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099760:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099764:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099766:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9ee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.099768:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099771:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099775:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cf39a3200) 00010000:00010000:2.0:1762166757.099776:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.099778:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099780:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.099805:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae10 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 28 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.099813:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.099817:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:2.0:1762166757.099819:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166757.099821:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9fe00, rc 0) 00000100:00100000:2.0:1762166757.099868:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+27:37680:x1847765439995904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 510us (650us total) trans 4294968843 rc 0/0 00000100:00100000:2.0:1762166757.099877:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2513 00000100:00100000:3.0:1762166757.101248:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.101318:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439996160 00000100:00100000:0.0:1762166757.101325:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439996160 00000100:00100000:0.0:1762166757.101365:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 718 00000100:00100000:0.0:1762166757.101373:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+27:37680:x1847765439996160:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166757.101514:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+28:37680:x1847765439996160:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 142us (271us total) trans 4294968844 rc 0/0 00000100:00100000:0.0:1762166757.101520:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 718 00000100:00100000:3.0:1762166757.103070:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.103121:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439996416 00000100:00100000:2.0:1762166757.103130:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439996416 00000100:00100000:2.0:1762166757.103177:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2514 00000100:00100000:2.0:1762166757.103192:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+28:37680:x1847765439996416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166757.103207:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166757.103220:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0ae33 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b765b expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.103279:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.103289:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.103295:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.103317:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.103326:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 29 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.103335:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446778880:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166757.103418:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166757.104232:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446778880:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166757.104250:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:3.0:1762166757.104714:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.104753:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439996544 00000100:00100000:2.0:1762166757.104758:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439996544 00010000:00010000:2.0:1762166757.104776:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 30 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.104801:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 586 00000100:00100000:2.0:1762166757.104806:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:2418:x1847765439996544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166757.104815:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166757.104819:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 30 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.104829:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 30 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.104842:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae25 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7654 expref: 30 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.104851:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:2.0:1762166757.104854:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.104859:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.104863:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.104881:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166757.104911:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:2418:x1847765439996544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 105us (240us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166757.104921:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166757.104922:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 586 00010000:00010000:3.0:1762166757.104936:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:3.0:1762166757.104954:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:3.0:1762166757.105132:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0ae33 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.105151:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.105173:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:3.0:1762166757.105176:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166757.105178:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9e200, rc 0) 00000100:00100000:3.0:1762166757.105228:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:37680:x1847765439996416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2044us (2168us total) trans 4294968845 rc 0/0 00000100:00100000:3.0:1762166757.105235:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2514 00000100:00100000:3.0:1762166757.106315:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.106374:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439996672 00000100:00100000:2.0:1762166757.106383:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439996672 00000100:00100000:2.0:1762166757.106433:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2515 00000100:00100000:2.0:1762166757.106444:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:37680:x1847765439996672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166757.106467:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166757.106524:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae48 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7662 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.106611:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.106625:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.106634:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.106668:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.106682:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 30 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.106697:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446779008:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166757.106774:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166757.107706:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446779008:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166757.107727:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166757.107846:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.107894:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439996800 00000100:00100000:2.0:1762166757.107900:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439996800 00010000:00010000:2.0:1762166757.107930:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 31 pid: 12357 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.107954:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 587 00000100:00100000:2.0:1762166757.107959:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+31:2419:x1847765439996800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166757.107969:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166757.107974:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 31 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.107996:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 31 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.108019:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae3a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x12:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b765b expref: 31 pid: 12357 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.108035:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:2.0:1762166757.108040:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.108048:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.108055:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.108079:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166757.108098:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.108105:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166757.108125:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:2419:x1847765439996800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 157us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.108137:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 587 00000004:00200000:3.0:1762166757.108140:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:3.0:1762166757.108145:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166757.108163:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.108190:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae48 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7662 expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.108205:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7662 expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.108265:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:3.0:1762166757.108273:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166757.108275:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9ee00, rc 0) 00000100:00100000:3.0:1762166757.108305:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:37680:x1847765439996672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1864us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166757.108312:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2515 00000100:00100000:3.0:1762166757.109600:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166757.109655:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439997056 00000100:00100000:0.0:1762166757.109668:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439997056 00000100:00100000:0.0:1762166757.109715:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 719 00000100:00100000:0.0:1762166757.109725:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:37680:x1847765439997056:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166757.109940:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:37680:x1847765439997056:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 217us (345us total) trans 4294968846 rc 0/0 00000100:00100000:0.0:1762166757.109948:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 719 00000100:00100000:2.0:1762166757.119410:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166757.119554:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439997312 00000100:00100000:3.0:1762166757.119569:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439997312 00000100:00100000:3.0:1762166757.119639:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2516 00000100:00100000:3.0:1762166757.119652:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:37681:x1847765439997312:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166757.119685:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166757.119713:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb800/0x2f180c4effb0ae56 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7669 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.119808:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.119825:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.119840:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.119857:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.119863:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.119869:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.119978:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120002:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120009:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120015:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166757.120021:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120029:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120041:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:3.0:1762166757.120044:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166757.120049:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120054:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0ae5d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120068:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120074:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120079:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120092:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166757.120095:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120101:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120108:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cd1dddc00) 00010000:00010000:3.0:1762166757.120111:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166757.120113:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120119:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0ae64 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166757.120170:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb800/0x2f180c4effb0ae56 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7669 expref: 31 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.120181:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:3.0:1762166757.120184:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166757.120187:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb800/0x2f180c4effb0ae56 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7669 expref: 31 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.120198:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb800, rc 0) 00000100:00100000:3.0:1762166757.120281:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:37681:x1847765439997312:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 632us (896us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166757.120290:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2516 00000100:00100000:3.0:1762166757.122381:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.122451:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439997440 00000100:00100000:2.0:1762166757.122460:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439997440 00000100:00100000:2.0:1762166757.122538:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2517 00000100:00100000:2.0:1762166757.122545:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:37681:x1847765439997440:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166757.122611:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122626:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122637:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122652:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122658:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122665:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122729:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122735:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122739:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166757.122771:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00000004:00200000:2.0:1762166757.122775:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166757.122786:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122811:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122818:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122825:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122831:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9e200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.122834:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122839:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122848:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:2.0:1762166757.122850:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.122853:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122857:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae6b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122865:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122868:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122872:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122874:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9fe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.122880:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122884:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122888:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cf39a3200) 00010000:00010000:2.0:1762166757.122889:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.122891:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122894:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae72 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122903:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122906:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122909:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122912:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9f000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.122913:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122916:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122919:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:2.0:1762166757.122920:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.122922:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.122930:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae79 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166757.123010:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:37681:x1847765439997440:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 464us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.123018:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2517 00000100:00100000:0.0:1762166757.130356:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.130403:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439997696 00000100:00100000:2.0:1762166757.130414:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439997696 00000100:00100000:2.0:1762166757.130510:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2518 00000100:00100000:2.0:1762166757.130523:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:37684:x1847765439997696:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:2.0:1762166757.130543:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166757.130562:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae80 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7670 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.130632:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130645:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130655:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130666:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130673:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130679:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130805:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0ae95 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130814:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130821:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166757.130830:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 4 00010000:00010000:2.0:1762166757.130897:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130905:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130911:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130916:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9fe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.130920:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130926:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130937:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:2.0:1762166757.130939:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.130944:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130950:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9fe00/0x2f180c4effb0ae87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130969:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130975:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.130981:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.131000:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9e200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.131004:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.131010:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.131017:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x889a05d5 (ffff945cf39a3200) 00010000:00010000:2.0:1762166757.131020:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.131023:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.131028:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9e200/0x2f180c4effb0ae8e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x889a05d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166757.131062:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f000/0x2f180c4effb0ae80 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7670 expref: 33 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.131074:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0ae95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7670 expref: 32 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.131080:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:2.0:1762166757.131088:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166757.131091:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9f400, rc 0) 00000100:00100000:2.0:1762166757.131145:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+32:37684:x1847765439997696:12345-192.168.204.38@tcp:101:cat.0 Request processed in 625us (798us total) trans 4294968847 rc 0/0 00000100:00100000:2.0:1762166757.131153:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2518 00000100:00100000:3.0:1762166757.132361:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.132411:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439997824 00000100:00100000:2.0:1762166757.132418:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439997824 00000100:00100000:2.0:1762166757.132452:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 271 00000100:00100000:2.0:1762166757.132457:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+32:2418:x1847765439997824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166757.132466:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166757.132498:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0ae95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7670 expref: 32 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.132509:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:2.0:1762166757.132512:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166757.132545:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+31:2418:x1847765439997824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 87us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.132553:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 271 00000100:00100000:3.0:1762166757.133012:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166757.133045:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439997952 00000100:00100000:2.0:1762166757.133049:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439997952 00002000:00100000:2.0:1762166757.133077:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3e:0x0] (0->4095) req@ffff945bc55df100 x1847765439997952/t0(0) o3->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:543/0 lens 488/0 e 0 to 0 dl 1762166768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166757.133088:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55df100 with x1847765439997952 ext(0->4095) 00002000:00010000:2.0:1762166757.133092:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55df100 00000100:00100000:2.0:1762166757.133124:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 436 00000100:00100000:2.0:1762166757.133132:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765439997952:12345-192.168.204.38@tcp:3:cat.0 00000100:00100000:2.0:1762166757.133268:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765439997952:12345-192.168.204.38@tcp:3:cat.0 Request processed in 136us (255us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166757.133275:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 436 00002000:00100000:2.0:1762166757.133282:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3e:0x0] (0->4095) req@ffff945bc55df100 x1847765439997952/t0(0) o3->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:543/0 lens 488/4536 e 0 to 0 dl 1762166768 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166757.133288:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55df100 with x1847765439997952 ext(0->4095) 00002000:00010000:2.0:1762166757.133291:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55df100 00000100:00100000:0.0:1762166757.134757:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166757.134824:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439998208 00000100:00100000:1.0:1762166757.134831:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439998208 00000100:00100000:1.0:1762166757.134872:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 720 00000100:00100000:1.0:1762166757.134881:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+31:37684:x1847765439998208:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:1.0:1762166757.135056:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+32:37684:x1847765439998208:12345-192.168.204.38@tcp:35:cat.0 Request processed in 176us (303us total) trans 4294968848 rc 0/0 00000100:00100000:1.0:1762166757.135069:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 720 00000004:00080000:3.0:1762166757.138612:0:9159:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 376287132273ns, next at 377287129760ns, rc = 0 00000100:00100000:0.0:1762166757.138618:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446779264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166757.138643:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446779136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166757.138687:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166757.138748:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446779264 00000100:00100000:2.0:1762166757.138757:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446779264 00000100:00100000:2.0:1762166757.138804:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1762166757.138824:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446779264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1762166757.138848:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 39190208 pending 0 free 3920338944 avail 3688759296 00000100:00100000:2.0:1762166757.138903:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446779264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166757.138910:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1762166757.138953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166757.138981:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446779264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166757.138983:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446779136 00000100:00100000:3.0:1762166757.139004:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446779136 00000100:00100000:3.0:1762166757.139054:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00080000:2.0:1762166757.139055:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166757.139065:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446779136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1762166757.139077:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 39190208 pending 0 free 3920338944 avail 3688759296 00000100:00100000:3.0:1762166757.139113:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446779136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166757.139120:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1762166757.139130:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836632 gen 2 00000004:00080000:2.0:1762166757.139135:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5588380, transno 21474836631 00000004:00080000:2.0:1762166757.139147:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5589c00, transno 21474836632 00000100:00100000:2.0:1762166757.139154:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446779136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1762166757.139626:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1762166757.140157:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 9 committed 00000001:00080000:3.0:1762166757.140201:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967369 is committed 00000020:00080000:3.0:1762166757.140210:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf1c86000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1762166757.140218:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37bea00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c86240 00000020:00080000:3.0:1762166757.140223:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].5 00000020:00080000:3.0:1762166757.140228:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37be300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc44f8600 00010000:00010000:2.0:1762166757.140229:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00000020:00080000:3.0:1762166757.140240:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].5 00010000:00010000:2.0:1762166757.140252:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00000004:00080000:3.0:1762166757.140263:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 6 committed 00010000:00010000:2.0:1762166757.140268:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166757.140276:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4a00 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:0.0:1762166757.140276:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 5 committed batchid 4 00000004:00080000:3.0:1762166757.140278:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 8 committed 00010000:00010000:2.0:1762166757.140283:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166757.140290:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00000100:00100000:1.0:1762166757.140292:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446779392:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1762166757.140305:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x8f0a8bfd (ffff945bc477fc00) 00010000:00010000:2.0:1762166757.140310:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.140313:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00000020:00080000:0.0:1762166757.140315:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4 00010000:00010000:2.0:1762166757.140320:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0a74f lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x4:0x0].0x8f0a8bfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00000100:00100000:0.0:1762166757.140330:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446779520:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1762166757.140347:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166757.140352:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166757.140355:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166757.140361:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3dc7000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166757.140366:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00000100:00100000:0.0:1762166757.140378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166757.140380:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166757.140398:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:2.0:1762166757.140403:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166757.140409:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00000100:00100000:1.0:1762166757.140411:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446779648:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1762166757.140430:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3dc7000/0x2f180c4effb0a7e2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00000100:00100000:3.0:1762166757.140444:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166757.140532:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446779520 00000100:00100000:1.0:1762166757.140539:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446779520 00000100:00100000:0.0:1762166757.140557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166757.140612:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446779392 00000100:00100000:2.0:1762166757.140621:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446779392 00000100:00100000:1.0:1762166757.140621:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446779648 00000100:00100000:1.0:1762166757.140628:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446779648 00000100:00100000:0.0:1762166757.140652:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1762166757.140669:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446779520:12345-0@lo:6:osp-syn-0-1.0 00000100:00080000:3.0:1762166757.140681:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166757.140691:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00002000:00080000:0.0:1762166757.140698:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:18 count 1 00000100:00100000:1.0:1762166757.140704:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1762166757.140709:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446779392:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1762166757.140724:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1762166757.140729:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:17 count 1 00000100:00100000:1.0:1762166757.140738:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446779648:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1762166757.140748:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.140750:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 8 pid: 8382 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1762166757.140766:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:17 count 1 00010000:00010000:0.0:1762166757.140776:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166757.140777:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 8 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166757.140780:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166757.140785:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.140792:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.140806:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.140812:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.140819:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.140838:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 14 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.140848:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166757.140851:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166757.140855:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.140859:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 8 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.140860:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 8 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166757.140907:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 8 pid: 8382 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.140910:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 8 pid: 8382 timeout: 476 lvb_type: 1 00000100:00100000:0.0:1762166757.140962:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446779904:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166757.140967:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446779776:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166757.140971:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 14 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.141014:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 14 pid: 8382 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166757.141034:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446780032:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166757.141048:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166757.141048:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79aeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166757.141090:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166757.142372:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446779776:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166757.142387:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446779904:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166757.142406:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.142416:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166757.142426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166757.142473:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446780032:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166757.142474:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166757.142517:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166757.142543:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439998464 00000100:00100000:1.0:1762166757.142550:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439998464 00000100:00100000:0.0:1762166757.142567:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166757.142572:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 9 pid: 8382 timeout: 476 lvb_type: 0 00000100:00100000:3.0:1762166757.142618:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439998336 00000100:00100000:1.0:1762166757.142618:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439998592 00000100:00100000:1.0:1762166757.142623:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439998592 00000100:00100000:0.0:1762166757.142631:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 588 00000100:00100000:3.0:1762166757.142632:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439998336 00010000:00010000:1.0:1762166757.142642:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 15 pid: 8382 timeout: 476 lvb_type: 0 00000100:00100000:0.0:1762166757.142643:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765439998464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166757.142656:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 10 pid: 8382 timeout: 476 lvb_type: 1 00010000:00010000:0.0:1762166757.142659:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166757.142668:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 10 pid: 8382 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166757.142676:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 589 00010000:00010000:0.0:1762166757.142687:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 10 pid: 8382 timeout: 476 lvb_type: 0 00000100:00100000:1.0:1762166757.142692:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2418:x1847765439998592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166757.142703:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166757.142706:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 590 00010000:00010000:1.0:1762166757.142716:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 15 pid: 8382 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1762166757.142716:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4400/0x2f180c4effb0a6e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b745c expref: 10 pid: 8382 timeout: 476 lvb_type: 0 00000100:00100000:2.0:1762166757.142740:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765439998336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166757.142742:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 15 pid: 8382 timeout: 476 lvb_type: 0 00010000:00010000:0.0:1762166757.142748:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166757.142755:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166757.142764:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.142767:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0a6ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b744e expref: 15 pid: 8382 timeout: 476 lvb_type: 0 00010000:00010000:2.0:1762166757.142775:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166757.142795:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.142797:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.142800:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 9 pid: 8382 timeout: 476 lvb_type: 1 00010000:00010000:1.0:1762166757.142801:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166757.142807:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.142845:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.142854:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 9 pid: 8382 timeout: 476 lvb_type: 1 00010000:00010000:0.0:1762166757.142858:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166757.142863:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166757.142882:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.142895:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.142896:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0a6a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7447 expref: 9 pid: 8382 timeout: 476 lvb_type: 1 00000100:00100000:1.0:1762166757.142909:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765439998592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 215us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166757.142910:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765439998464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 262us (482us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166757.142923:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166757.142953:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 589 00010000:00010000:3.0:1762166757.142965:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.142971:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166757.142973:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 588 00010000:00010000:2.0:1762166757.142976:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166757.142985:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166757.142998:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166757.143007:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143015:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.143019:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.143019:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166757.143029:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.143044:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.143071:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166757.143074:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.143078:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143088:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166757.143093:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166757.143101:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166757.143110:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.143120:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0aea3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166757.143139:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2418:x1847765439998336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 415us (663us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166757.143142:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166757.143152:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166757.143162:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 590 00010000:00010000:0.0:1762166757.143175:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166757.143180:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.143189:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.143212:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.143220:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf786be00/0x2f180c4effb0aeb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143223:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143240:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166757.143242:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166757.143247:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166757.143254:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166757.143257:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143268:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143290:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166757.143306:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166757.143313:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143323:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9f400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166757.143328:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143339:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143362:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143371:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9f400/0x2f180c4effb0aeaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166757.143396:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166757.143400:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166757.143403:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166757.143539:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1762166757.144293:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869329 is committed 00000001:00080000:0.0:1762166757.144306:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869328 is committed 00000001:00080000:0.0:1762166757.144314:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869327 is committed 00000100:00100000:3.0:1762166757.144913:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446779520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4249us (4536us total) trans 21474836647 rc 0/0 00000100:00100000:3.0:1762166757.144923:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000004:00080000:0.0:1762166757.144950:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406c380/2, rc 0, transno 21474836647 00000100:00100000:1.0:1762166757.144954:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446779648:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4236us (4399us total) trans 17179869329 rc 0/0 00000100:00100000:0.0:1762166757.144962:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446779520:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166757.144965:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000004:00080000:1.0:1762166757.145016:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55df800, transno 17179869329 00000100:00100000:1.0:1762166757.145028:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869329 gen 2 00000004:00080000:1.0:1762166757.145031:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bba300, transno 17179869314 00000004:00080000:1.0:1762166757.145035:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55df800/2, rc 0, transno 17179869329 00000100:00100000:1.0:1762166757.145040:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446779648:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1762166757.145434:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446779392:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4730us (4997us total) trans 21474836648 rc 0/0 00000100:00100000:2.0:1762166757.145450:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000004:00080000:3.0:1762166757.145474:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406ce00/2, rc 0, transno 21474836648 00000100:00100000:3.0:1762166757.145509:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446779392:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1762166758.162634:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166758.162670:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446780160:0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.162677:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446780288:0@lo:400:kworker.0 00000100:00100000:1.0:1762166758.162696:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446780416:0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.162753:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166758.162754:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166758.162755:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166758.162773:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446780544:0@lo:400:kworker.0 00000100:00100000:3.0:1762166758.162806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166758.162828:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446780672:0@lo:400:kworker.0 00000100:00100000:3.0:1762166758.162830:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446781056:0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.162830:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446780800:0@lo:400:kworker.0 00000100:00100000:1.0:1762166758.162830:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446780928:0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.162875:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166758.162882:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166758.162882:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446780288 00000100:00100000:2.0:1762166758.162890:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446780288 00000100:00100000:1.0:1762166758.162900:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446780416 00000100:00100000:0.0:1762166758.162902:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446781184:0@lo:400:kworker.0 00000100:00100000:1.0:1762166758.162907:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446780416 00000100:00100000:3.0:1762166758.162917:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446781568:0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.162928:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446780544 00000100:00100000:2.0:1762166758.162933:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446780544 00000100:00100000:0.0:1762166758.162939:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166758.162945:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446780672 00000100:00100000:1.0:1762166758.162950:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446780672 00000100:00100000:2.0:1762166758.162961:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1762166758.162983:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446781696:0@lo:400:kworker.0 00000100:00100000:3.0:1762166758.162985:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166758.162986:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1762166758.162993:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446780288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166758.162998:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446780416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.163023:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166758.163029:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1762166758.163039:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446780672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.163055:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446780288:12345-0@lo:400:kworker.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166758.163059:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446780416:12345-0@lo:400:kworker.0 Request processed in 63us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166758.163065:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446780160 00000100:00100000:0.0:1762166758.163071:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446780160 00000100:00100000:1.0:1762166758.163072:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1762166758.163073:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446780672:12345-0@lo:400:kworker.0 Request processed in 37us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166758.163075:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1762166758.163085:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1762166758.163104:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446781568 00000100:00100000:3.0:1762166758.163109:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446781696 00000100:00100000:2.0:1762166758.163109:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446781568 00000100:00100000:3.0:1762166758.163114:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446781696 00000100:00100000:0.0:1762166758.163121:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1762166758.163122:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1762166758.163132:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446780160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166758.163135:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446780544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.163146:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1762166758.163158:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1762166758.163158:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446781568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166758.163172:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446781696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.163177:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446780160:12345-0@lo:400:kworker.0 Request processed in 46us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166758.163185:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1762166758.163190:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446780544:12345-0@lo:400:kworker.0 Request processed in 58us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166758.163198:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1762166758.163209:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446781568:12345-0@lo:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166758.163217:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446781696:12345-0@lo:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166758.163220:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1762166758.163231:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1762166758.163231:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446781056 00000100:00100000:1.0:1762166758.163234:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446781056 00000100:00100000:2.0:1762166758.163254:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446781184 00000100:00100000:0.0:1762166758.163254:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446780672:0@lo:400:kworker.0 00000100:00100000:3.0:1762166758.163260:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166758.163261:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446781184 00000100:00100000:1.0:1762166758.163263:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1762166758.163274:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446781056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.163277:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446781696:0@lo:400:kworker.0 00000100:00100000:3.0:1762166758.163287:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446781312:0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.163291:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446780800 00000100:00100000:0.0:1762166758.163295:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446780160:0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.163296:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446780800 00000100:00100000:1.0:1762166758.163317:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446781056:12345-0@lo:400:kworker.0 Request processed in 44us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166758.163318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166758.163322:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1762166758.163329:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1762166758.163333:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446781184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.163341:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1762166758.163351:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446780288:0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.163353:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446780800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166758.163358:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446781312 00000100:00100000:1.0:1762166758.163363:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446781312 00000100:00100000:2.0:1762166758.163369:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446781184:12345-0@lo:400:kworker.0 Request processed in 41us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166758.163374:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:2.0:1762166758.163391:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166758.163396:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00080000:2.0:1762166758.163397:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1762166758.163400:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166758.163407:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446781312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166758.163419:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446780544:0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.163424:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446780800:12345-0@lo:400:kworker.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166758.163435:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446781056:0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.163435:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1762166758.163447:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446781312:12345-0@lo:400:kworker.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166758.163451:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446780800:0@lo:400:kworker.0 00000100:00100000:3.0:1762166758.163456:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446781568:0@lo:400:kworker.0 00000100:00100000:1.0:1762166758.163457:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1762166758.163495:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869328 gen 2 00000004:00080000:0.0:1762166758.163501:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bba680, transno 17179869315 00000100:00100000:1.0:1762166758.163502:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166758.163506:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446781312:0@lo:400:kworker.0 00000004:00080000:0.0:1762166758.163514:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bbb480, transno 17179869316 00000004:00080000:0.0:1762166758.163520:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bb8700, transno 17179869317 00000004:00080000:0.0:1762166758.163525:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc558b100, transno 17179869319 00000100:00100000:1.0:1762166758.163531:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446781440:0@lo:400:kworker.0 00000004:00080000:0.0:1762166758.163531:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869321 committed transno 17179869328 00000004:00080000:0.0:1762166758.163549:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5804380, transno 17179869322 00000100:00100000:2.0:1762166758.163550:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446780928 00000100:00100000:2.0:1762166758.163556:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446780928 00000004:00080000:0.0:1762166758.163557:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db4700, transno 17179869323 00000100:00100000:1.0:1762166758.163561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166758.163564:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef7b80, transno 17179869326 00000004:00080000:0.0:1762166758.163569:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4533b80, transno 17179869328 00000100:00100000:0.0:1762166758.163575:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446781184:0@lo:400:kworker.0 00000100:00100000:2.0:1762166758.163595:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1762166758.163605:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446780928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166758.163607:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446780416:0@lo:400:kworker.0 00000100:00100000:0.0:1762166758.163609:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446781440 00000100:00100000:0.0:1762166758.163619:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446781440 00000100:00100000:2.0:1762166758.163650:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446780928:12345-0@lo:400:kworker.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166758.163659:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1762166758.163660:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1762166758.163665:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446780928:0@lo:400:kworker.0 00000004:00080000:3.0:1762166758.163671:0:10004:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1762166758.163671:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446781440:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1762166758.163683:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1762166758.163692:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166758.163716:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446781440:12345-0@lo:400:kworker.0 Request processed in 48us (157us total) trans 0 rc 0/0 00000004:00080000:3.0:1762166758.163720:0:10004:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1762166758.163726:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1762166758.163737:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446781440:0@lo:400:kworker.0 00000001:02000400:0.0:1762166759.066597:0:30131:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_44c skipping ALWAYS excluded test 44c 00010000:00010000:2.0:1762166759.186610:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762166759.570323:0:30179:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 44d: lfs mirror split does not break size ========================================================== 05:45:59 (1762166759) 00000100:00100000:0.0:1762166759.598669:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.598726:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439998848 00000100:00100000:1.0:1762166759.598738:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439998848 00000100:00080000:3.0:1762166759.598789:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166759.598812:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2519 00000100:00100000:1.0:1762166759.598824:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:38396:x1847765439998848:12345-192.168.204.38@tcp:36:mkdir.0 00000100:00100000:1.0:1762166759.598923:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446781824:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.598990:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.599053:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446781824 00000100:00100000:1.0:1762166759.599056:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.599059:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446781824 00000100:00100000:0.0:1762166759.599104:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1762166759.599114:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6494:x1847765446781824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.599187:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6494:x1847765446781824:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.599195:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1762166759.599216:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446781824:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.599263:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446781952:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.599287:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.599306:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.599308:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446781952 00000100:00100000:0.0:1762166759.599313:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446781952 00000100:00100000:0.0:1762166759.599344:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1762166759.599354:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6494:x1847765446781952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.599428:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6494:x1847765446781952:12345-0@lo:1000:mdt00_000.0 Request processed in 78us (140us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166759.599436:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1762166759.599444:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446781952:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1762166759.599513:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166759.599521:0:6494:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166759.599528:0:6494:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166759.599537:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782080:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1762166759.599556:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.599583:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446782080 00000100:00100000:1.0:1762166759.599587:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.599589:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446782080 00000100:00100000:0.0:1762166759.599622:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1762166759.599630:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6494:x1847765446782080:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1762166759.599639:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166759.599658:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0aeb8 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.599680:0:7427:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 31 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.599690:0:7427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0aeb8 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.599713:0:7427:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 31 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.599727:0:7427:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 31 pid: 7432 timeout: 478 lvb_type: 0 00000100:00100000:0.0:1762166759.599737:0:7427:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7427:1847765446782208:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166759.599797:0:7427:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785c480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.600714:0:7427:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7427:1847765446782208:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166759.600730:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0aeb8 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.600751:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166759.600754:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166759.600759:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0aeb8 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.600767:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3c00, rc 0) 00000100:00100000:1.0:1762166759.600808:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446782080:12345-0@lo:101:mdt00_000.0 Request processed in 1179us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.600816:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1762166759.600825:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782080:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1762166759.600839:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.600850:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.600985:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.601035:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439998976 00000100:00100000:1.0:1762166759.601042:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439998976 00010000:00010000:1.0:1762166759.601076:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 32 pid: 7432 timeout: 478 lvb_type: 0 00000100:00080000:3.0:1762166759.601104:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166759.601108:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 591 00000100:00100000:1.0:1762166759.601118:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+32:2419:x1847765439998976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166759.601128:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166759.601134:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 32 pid: 7432 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1762166759.601145:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 32 pid: 7432 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1762166759.601164:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aa58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7543 expref: 32 pid: 7432 timeout: 478 lvb_type: 0 00010000:00010000:1.0:1762166759.601175:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166759.601186:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0aeb8 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.601195:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0aeb8 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.601203:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0aeb8 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.601237:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0aeb8 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166759.601248:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8398:1847765446782336:0@lo:105: 00000100:00100000:1.0:1762166759.601279:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.601310:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166759.601326:0:8397:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1762166759.601338:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446782336 00000100:00100000:3.0:1762166759.601342:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446782336 00000100:00100000:3.0:1762166759.601375:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1762166759.601383:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8398:x1847765446782336:12345-0@lo:105: 00010000:00010000:3.0:1762166759.601393:0:8397:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.601403:0:8397:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.601412:0:8397:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.601419:0:8397:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.601426:0:8397:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.601433:0:8397:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.601453:0:8397:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945cf786b000) 00010000:00010000:0.0:1762166759.601463:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.601471:0:6494:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166759.601519:0:6494:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1762166759.601520:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8398:x1847765446782336:12345-0@lo:105: Request processed in 136us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.601531:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1762166759.601541:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8398:1847765446782336:0@lo:105: 00010000:00010000:0.0:1762166759.601547:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.601557:0:6494:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166759.601558:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166759.601568:0:6494:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166759.601584:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782464:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1762166759.601604:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+31:2419:x1847765439998976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 486us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.601618:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 591 00000100:00100000:0.0:1762166759.601620:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.601643:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785c240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.601648:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446782464 00000100:00100000:1.0:1762166759.601653:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446782464 00000100:00100000:1.0:1762166759.601684:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1762166759.601694:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446782464:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1762166759.601705:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.601717:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aecd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0aec6 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.601733:0:7427:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aecd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0aec6 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.601751:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aecd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0aec6 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.601759:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xedb28f26 (ffff945cd0738900) 00010000:00010000:1.0:1762166759.601762:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166759.601764:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b200, rc 0) 00000100:00100000:1.0:1762166759.601800:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782464:12345-0@lo:101:mdt00_000.0 Request processed in 109us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.601807:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1762166759.601824:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782464:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1762166759.601832:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.601838:0:6494:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166759.601847:0:6494:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1762166759.601867:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782592:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.601884:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.601899:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.601915:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446782592 00000100:00100000:1.0:1762166759.601920:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446782592 00000100:00100000:1.0:1762166759.601956:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1762166759.601964:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.602023:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782592:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.602030:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1762166759.602050:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782592:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.602080:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782720:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.602100:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.602123:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.602124:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446782720 00000100:00100000:1.0:1762166759.602129:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446782720 00000100:00100000:1.0:1762166759.602157:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1762166759.602165:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.602237:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782720:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (135us total) trans 0 rc -2/-2 00000100:00100000:1.0:1762166759.602245:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1762166759.602257:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782720:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.602322:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782848:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.602354:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.602377:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.602395:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446782848 00000100:00100000:1.0:1762166759.602401:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446782848 00000100:00100000:1.0:1762166759.602431:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1762166759.602446:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.602531:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782848:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (176us total) trans 0 rc -2/-2 00000100:00100000:1.0:1762166759.602540:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1762166759.602592:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782848:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.602637:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782976:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.602659:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.602675:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.602682:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446782976 00000100:00100000:1.0:1762166759.602688:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446782976 00000100:00100000:1.0:1762166759.602718:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1762166759.602729:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782976:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.602802:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446782976:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.602809:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446782976:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.602811:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1762166759.602847:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446783104:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.602866:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.602881:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.602889:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446783104 00000100:00100000:1.0:1762166759.602894:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446783104 00000100:00100000:1.0:1762166759.602923:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1762166759.602932:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446783104:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166759.603000:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446783104:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.603006:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1762166759.603089:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446783104:0@lo:1000:mdt00_000.0 00000040:00080000:0.0:1762166759.603593:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].6, 992 off39544 00000040:00080000:0.0:1762166759.603655:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].6, 1144 off40416 00000004:00080000:0.0:1762166759.603662:0:6494:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945cf785c240 with version 13 00000004:00080000:1.0:1762166759.603703:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 13 rpc_version 13 00000020:00100000:1.0:1762166759.603722:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166759.603731:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc4531500 x1847765446783360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166759.603746:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446783360:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166759.603781:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.603800:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.603802:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446783360 00000100:00100000:0.0:1762166759.603806:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446783360 00000100:00100000:0.0:1762166759.603838:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1762166759.603845:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc635d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7425:x1847765446783360:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166759.604123:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc635d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7425:x1847765446783360:12345-0@lo:1000:osp_up0-1.0 Request processed in 278us (340us total) trans 4294968849 rc 0/0 00000100:00100000:0.0:1762166759.604131:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1762166759.604171:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446783360:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1762166759.604517:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166759.604531:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166759.604541:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166759.604558:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000473b9317 reply state 00000000af22506f transno 4294967370 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166759.604568:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166759.604575:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:3.0:1762166759.604577:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166759.604580:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166759.604586:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x5:0x0]: returning size 4096 00000004:00080000:3.0:1762166759.604593:0:6494:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1762166759.604602:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.604610:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.604617:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.604639:0:6494:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1762166759.604645:0:6494:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1762166759.604651:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.604651:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166759.604665:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.604677:0:6494:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.604680:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b000 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:0.0:1762166759.604688:0:6483:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1762166759.604698:0:6483:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.604722:0:6483:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.604729:0:6483:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1762166759.604759:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:38396:x1847765439998848:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 5936us (6094us total) trans 4294967370 rc 0/0 00010000:00010000:0.0:1762166759.604765:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166759.604769:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2519 00010000:00010000:0.0:1762166759.604779:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cf786b000/0x2f180c4effb0aeb8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0aebf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.604791:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166759.604794:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166759.604796:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166759.604805:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166759.604816:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446783488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1762166759.604849:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.604918:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446783488 00000100:00100000:1.0:1762166759.604923:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446783488 00000100:00100000:1.0:1762166759.604973:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1762166759.604982:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765446783488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166759.604992:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166759.605007:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0aebf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb0aeb8 expref: 9 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.605019:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166759.605022:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166759.605052:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765446783488:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.605058:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1762166759.605085:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446783488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1762166759.611077:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.611141:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439999104 00000100:00100000:1.0:1762166759.611151:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439999104 00000100:00100000:1.0:1762166759.611217:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2520 00000100:00100000:1.0:1762166759.611232:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5f20b66-016a-4159-9d62-071c0da3ef0b+31:38400:x1847765439999104:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166759.611256:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.611274:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aedb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7677 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.611336:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aee2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166759.611350:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166759.611362:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166759.611413:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166759.611417:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166759.611436:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166759.611460:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0aedb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7677 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.611495:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7677 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.611504:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166759.611507:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166759.611511:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786be00, rc 0) 00000100:00100000:1.0:1762166759.611573:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5f20b66-016a-4159-9d62-071c0da3ef0b+32:38400:x1847765439999104:12345-192.168.204.38@tcp:101:dd.0 Request processed in 347us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.611581:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2520 00000100:00100000:3.0:1762166759.612838:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.612880:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439999232 00000100:00100000:0.0:1762166759.612886:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439999232 00000100:00100000:0.0:1762166759.612929:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2521 00000100:00100000:0.0:1762166759.612958:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5f20b66-016a-4159-9d62-071c0da3ef0b+32:38400:x1847765439999232:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166759.612971:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166759.612982:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0aee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b767e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.613019:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.613029:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.613038:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.613048:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.613058:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aecd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0aec6 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.613066:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.613096:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aecd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0aec6 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.613112:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446783616:0@lo:104: 00000100:00100000:0.0:1762166759.613149:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.613189:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbea80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166759.613195:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446783616 00000100:00100000:3.0:1762166759.613201:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446783616 00000100:00100000:3.0:1762166759.613234:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1762166759.613242:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6494:x1847765446783616:12345-0@lo:104: 00010000:00010000:3.0:1762166759.613253:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.613303:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1762166759.613309:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6494:x1847765446783616:12345-0@lo:104: Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.613316:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:2.0:1762166759.613324:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166759.613332:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.613332:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446783616:0@lo:104: 00010000:00010000:2.0:1762166759.613345:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3800 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:2.0:1762166759.613349:0:7420:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166759.613356:0:7420:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.613356:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166759.613379:0:7420:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.613384:0:7420:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166759.613413:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.613421:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bcc9e3800/0x2f180c4effb0aec6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0aecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.613423:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762166759.613440:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446783744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166759.613441:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166759.613445:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166759.613448:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166759.613497:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166759.613525:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446783744 00000100:00100000:2.0:1762166759.613530:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446783744 00010000:00010000:2.0:1762166759.613549:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aecd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0aec6 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.613574:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1762166759.613590:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446783744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166759.613599:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1762166759.614967:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968849 is committed 00000001:00080000:0.0:1762166759.615010:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968848 is committed 00010000:00010000:2.0:1762166759.615052:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.615065:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.615072:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.615078:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166759.615083:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.615091:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.615104:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x9da75000 (ffff945cd0738000) 00010000:00010000:2.0:1762166759.615108:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166759.615112:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.615117:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ada7 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x9da75000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166759.615146:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0aecd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0aec6 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.615157:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xedb28f26 (ffff945cd0738900) 00010000:00010000:3.0:1762166759.615160:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166759.615166:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166759.615176:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166759.615194:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166759.615225:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166759.615240:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446783744:12345-0@lo:103:ldlm_bl.0 Request processed in 1647us (1760us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166759.615241:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166759.615266:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1762166759.615273:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446783744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1762166759.615408:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6494:1847765446783872:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1762166759.615576:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166759.615610:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166759.615620:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446783872 00000100:00100000:2.0:1762166759.615626:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446783872 00000100:00100000:2.0:1762166759.615668:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1762166759.615679:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6494:x1847765446783872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166759.615781:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6494:x1847765446783872:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166759.615789:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1762166759.615794:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6494:1847765446783872:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1762166759.615843:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aefe lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615853:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aefe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615861:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aefe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:0.0:1762166759.615880:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aefe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615892:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615898:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615910:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615916:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615921:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166759.615924:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615930:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615938:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166759.615954:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166759.615958:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615963:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0aef0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615973:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615979:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615984:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.615990:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166759.615993:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.616009:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.616017:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xedb28f26 (ffff945cd0738900) 00010000:00010000:0.0:1762166759.616020:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166759.616022:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.616028:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0aef7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166759.616069:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0aee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b767e expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.616085:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aefe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b767e expref: 15 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.616092:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc403a500) 00010000:00010000:0.0:1762166759.616094:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166759.616096:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3a00, rc 0) 00000100:00100000:0.0:1762166759.616138:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38400:x1847765439999232:12345-192.168.204.38@tcp:101:dd.0 Request processed in 3184us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.616144:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2521 00000100:00100000:3.0:1762166759.617406:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.617447:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439999360 00000100:00100000:0.0:1762166759.617452:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439999360 00000100:00100000:1.0:1762166759.617543:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2522 00000100:00100000:1.0:1762166759.617562:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:38400:x1847765439999360:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166759.617581:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.617595:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0af05 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7685 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.617646:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0af0c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.617656:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0af0c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.617675:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0af0c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.617715:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1762166759.617719:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1762166759.617745:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0af05 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7685 expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.617758:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0af0c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7685 expref: 12 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.617765:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:1.0:1762166759.617768:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1762166759.617770:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a800, rc 0) 00000100:00100000:1.0:1762166759.617809:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:38400:x1847765439999360:12345-192.168.204.38@tcp:101:dd.0 Request processed in 256us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.617816:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2522 00000100:00100000:3.0:1762166759.619169:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166759.619208:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439999616 00000100:00100000:2.0:1762166759.619216:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439999616 00000100:00100000:2.0:1762166759.619257:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2523 00000100:00100000:2.0:1762166759.619266:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:38400:x1847765439999616:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166759.619277:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166759.619288:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9ea00/0x2f180c4effb0af13 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b768c expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.619349:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 3/0,1 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.619357:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.619363:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.619409:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.619414:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.619418:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166759.619543:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765446784000:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1762166759.619594:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166759.619630:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc322e180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166759.619656:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446784000 00000100:00100000:3.0:1762166759.619666:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446784000 00000100:00100000:3.0:1762166759.619720:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1762166759.619731:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:12357:x1847765446784000:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1762166759.619844:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:12357:x1847765446784000:12345-0@lo:1000:mdt00_004.0 Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.619856:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1762166759.619865:0:12357:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968849 gen 2 00000004:00080000:2.0:1762166759.619872:0:12357:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968849 committed transno 4294968849 00000100:00100000:2.0:1762166759.619894:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765446784000:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1762166759.620090:0:9996:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9996:1847765446784256:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1762166759.620095:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446784128:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1762166759.620163:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x12:0x0], index 1: 0 00000100:00100000:3.0:1762166759.620170:0:9996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.620173:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166759.620233:0:9996:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6021480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166759.620272:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446784128 00000100:00100000:3.0:1762166759.620277:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446784128 00010000:00010000:2.0:1762166759.620317:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00000100:00080000:1.0:1762166759.620326:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1762166759.620327:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.620340:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166759.620349:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1762166759.620359:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446784128:12345-0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1762166759.620374:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.620384:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00002000:00000024:3.0:1762166759.620391:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 48702016 pending 0 free 3923488768 avail 3691966464 00010000:00010000:2.0:1762166759.620392:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.620404:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9fc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166759.620410:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.620416:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.620428:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:2.0:1762166759.620431:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166759.620435:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 2/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.620445:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9fc00/0x2f180c4effb0af1a lrc: 0/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000004:00010000:2.0:1762166759.620463:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a7d8a65d reply state 0000000016e91b1d transno 4294967371 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166759.620465:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446784128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.620517:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00010000:00010000:2.0:1762166759.620531:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.620543:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x3d8b1ba3 (ffff945cf39a3e00) 00010000:00010000:2.0:1762166759.620546:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166759.620551:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166759.620577:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446784128:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1762166759.620588:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9ea00/0x2f180c4effb0af13 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166759.620610:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446784256 00000100:00100000:3.0:1762166759.620618:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446784256 00010000:00010000:2.0:1762166759.620620:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.620629:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:2.0:1762166759.620633:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166759.620636:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3c9e000, rc 0) 00000100:00100000:3.0:1762166759.620667:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:3.0:1762166759.620683:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:9996:x1847765446784256:12345-0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1762166759.620694:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38400:x1847765439999616:12345-192.168.204.38@tcp:101:dd.0 Request processed in 1425us (1531us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1762166759.620704:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2523 00002000:00080000:3.0:1762166759.620713:0:9168:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:0.0:1762166759.624620:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.624662:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439999744 00000100:00100000:0.0:1762166759.624669:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439999744 00000100:00100000:0.0:1762166759.624757:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 904 00000100:00100000:0.0:1762166759.624774:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:38400:x1847765439999744:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166759.624800:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166759.624819:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7693 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1762166759.624951:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1762166759.625208:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166759.625235:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.625238:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.625249:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 7 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.625265:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 7 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.625281:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3200, rc 0) 00000100:00100000:0.0:1762166759.625351:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:38400:x1847765439999744:12345-192.168.204.38@tcp:101:dd.0 Request processed in 584us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.625362:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 904 00000100:00100000:0.0:1762166759.631696:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:9996:x1847765446784256:12345-0@lo:5:osp-pre-1-1.0 Request processed in 11009us (11525us total) trans 17179869330 rc 0/0 00000100:00100000:0.0:1762166759.631707:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:3.0:1762166759.631715:0:9996:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9996:1847765446784256:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1762166759.631729:0:9996:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x12:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1762166759.668010:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.668076:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765439999872 00000100:00100000:0.0:1762166759.668087:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765439999872 00002000:00100000:0.0:1762166759.668130:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x12:0x0] (0->4194303) req@ffff945bc5ef7800 x1847765439999872/t0(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:545/0 lens 488/0 e 0 to 0 dl 1762166770 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166759.668138:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5ef7800 with x1847765439999872 ext(0->4194303) 00002000:00010000:0.0:1762166759.668143:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5ef7800 00000100:00100000:0.0:1762166759.668180:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 437 00000100:00100000:0.0:1762166759.668187:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2418:x1847765439999872:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:0.0:1762166759.683320:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765439999872:12345-192.168.204.38@tcp:4:dd.0 Request processed in 15123us (15311us total) trans 17179869331 rc 0/0 00000100:00100000:0.0:1762166759.683334:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 437 00002000:00100000:0.0:1762166759.683346:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x12:0x0] (0->4194303) req@ffff945bc5ef7800 x1847765439999872/t17179869331(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:545/0 lens 488/448 e 0 to 0 dl 1762166770 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166759.683356:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5ef7800 with x1847765439999872 ext(0->4194303) 00002000:00010000:0.0:1762166759.683362:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5ef7800 00000100:00100000:2.0:1762166759.698694:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446784384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166759.698768:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166759.698804:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446784384 00000100:00100000:3.0:1762166759.698813:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446784384 00000100:00100000:3.0:1762166759.698864:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1762166759.698873:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446784384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1762166759.698954:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 57138880 pending 4218880 free 3923488768 avail 3691966464 00000100:00100000:2.0:1762166759.699058:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446784384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166759.699113:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446784384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 241us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.699119:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1762166759.710384:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.710420:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440000000 00000100:00100000:0.0:1762166759.710429:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440000000 00002000:00100000:0.0:1762166759.710467:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x12:0x0] (4194304->8388607) req@ffff945cf3db7480 x1847765440000000/t0(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:545/0 lens 488/0 e 0 to 0 dl 1762166770 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166759.710491:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7480 with x1847765440000000 ext(4194304->8388607) 00002000:00010000:0.0:1762166759.710497:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7480 00000100:00100000:0.0:1762166759.710520:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 438 00000100:00100000:0.0:1762166759.710528:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765440000000:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:0.0:1762166759.723604:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2419:x1847765440000000:12345-192.168.204.38@tcp:4:dd.0 Request processed in 13066us (13216us total) trans 17179869332 rc 0/0 00000100:00100000:0.0:1762166759.723617:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 438 00002000:00100000:0.0:1762166759.723629:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x12:0x0] (4194304->8388607) req@ffff945cf3db7480 x1847765440000000/t17179869332(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:545/0 lens 488/448 e 0 to 0 dl 1762166770 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166759.723639:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7480 with x1847765440000000 ext(4194304->8388607) 00002000:00010000:0.0:1762166759.723654:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7480 00000100:00100000:2.0:1762166759.726658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.726704:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440000256 00000100:00100000:1.0:1762166759.726712:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440000256 00000100:00100000:1.0:1762166759.726754:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 721 00000100:00100000:1.0:1762166759.726766:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38400:x1847765440000256:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:1.0:1762166759.726988:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38400:x1847765440000256:12345-192.168.204.38@tcp:35:dd.0 Request processed in 224us (331us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1762166759.727002:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 721 00000100:00100000:3.0:1762166759.733796:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.733855:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440000384 00000100:00100000:0.0:1762166759.733865:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440000384 00002000:00100000:0.0:1762166759.733911:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x12:0x0] (8388608->10485759) req@ffff945cf3db6300 x1847765440000384/t0(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:545/0 lens 488/0 e 0 to 0 dl 1762166770 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166759.733923:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6300 with x1847765440000384 ext(8388608->10485759) 00002000:00010000:0.0:1762166759.733929:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6300 00000100:00100000:0.0:1762166759.733965:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 439 00000100:00100000:0.0:1762166759.733973:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2419:x1847765440000384:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:0.0:1762166759.740740:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765440000384:12345-192.168.204.38@tcp:4:dd.0 Request processed in 6760us (6942us total) trans 17179869333 rc 0/0 00000100:00100000:0.0:1762166759.740754:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 439 00002000:00100000:0.0:1762166759.740767:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x12:0x0] (8388608->10485759) req@ffff945cf3db6300 x1847765440000384/t17179869333(0) o4->c5f20b66-016a-4159-9d62-071c0da3ef0b@192.168.204.38@tcp:545/0 lens 488/448 e 0 to 0 dl 1762166770 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166759.740778:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6300 with x1847765440000384 ext(8388608->10485759) 00002000:00010000:0.0:1762166759.740784:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6300 00000100:00100000:2.0:1762166759.750917:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.750970:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440000640 00000100:00100000:1.0:1762166759.750980:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440000640 00000100:00100000:1.0:1762166759.751032:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2524 00000100:00100000:1.0:1762166759.751042:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440000640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.751064:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.751081:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0af3d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b769a expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.751172:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.751186:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.751195:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.751224:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.751237:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 17 pid: 12357 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1762166759.751249:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446784512:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166759.751326:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.752099:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446784512:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166759.752116:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166759.752374:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166759.752403:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440000768 00000100:00100000:3.0:1762166759.752407:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440000768 00010000:00010000:3.0:1762166759.752424:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 18 pid: 12357 timeout: 478 lvb_type: 0 00000100:00100000:3.0:1762166759.752444:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 593 00000100:00100000:3.0:1762166759.752449:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:2418:x1847765440000768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166759.752456:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166759.752460:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 18 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1762166759.752502:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 18 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1762166759.752518:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e000/0x2f180c4effb0af28 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b768c expref: 18 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:3.0:1762166759.752528:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:3.0:1762166759.752531:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166759.752536:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166759.752540:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.752589:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.752605:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.752613:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166759.752621:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2418:x1847765440000768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (247us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166759.752624:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00000100:00100000:2.0:1762166759.752629:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 593 00010000:00010000:1.0:1762166759.752716:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0af3d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 18 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.752726:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.752730:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.752732:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166759.752734:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b200, rc 0) 00000100:00100000:1.0:1762166759.752759:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440000640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1720us (1848us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1762166759.752763:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2524 00000100:00100000:2.0:1762166759.753910:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.753963:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440001024 00000100:00100000:1.0:1762166759.753968:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440001024 00000100:00100000:1.0:1762166759.753999:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2525 00000100:00100000:1.0:1762166759.754008:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440001024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.754020:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.754030:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0af52 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76a1 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.754347:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.754362:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.754370:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.754378:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x7:0x0]: returning size 0 00010000:00010000:1.0:1762166759.754407:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0af52 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 20 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.754419:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 19 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.754426:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738400) 00010000:00010000:1.0:1762166759.754428:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166759.754431:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b600, rc 0) 00000100:00100000:1.0:1762166759.754465:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:38407:x1847765440001024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 458us (555us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1762166759.754472:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2525 00000100:00100000:3.0:1762166759.755403:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.755441:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440001280 00000100:00100000:1.0:1762166759.755445:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440001280 00000100:00100000:1.0:1762166759.755473:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2526 00000100:00100000:1.0:1762166759.755502:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:38407:x1847765440001280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.755513:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.755521:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0af67 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76a8 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.755564:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.755579:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 20 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.755586:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.755606:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 20 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.755616:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 20 pid: 12357 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1762166759.755626:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446784640:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166759.755670:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.756348:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446784640:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166759.756361:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166759.756653:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166759.756688:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440001408 00000100:00100000:2.0:1762166759.756692:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440001408 00010000:00010000:2.0:1762166759.756712:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 21 pid: 12357 timeout: 478 lvb_type: 0 00000100:00100000:2.0:1762166759.756740:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 594 00000100:00100000:2.0:1762166759.756748:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:2418:x1847765440001408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166759.756755:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166759.756759:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 21 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1762166759.756767:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 21 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1762166759.756776:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b600/0x2f180c4effb0af59 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a1 expref: 21 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:2.0:1762166759.756783:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738400) 00010000:00010000:2.0:1762166759.756786:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.756796:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.756800:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.756817:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166759.756840:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:2418:x1847765440001408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 94us (188us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166759.756843:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166759.756846:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 594 00010000:00010000:1.0:1762166759.756856:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.756867:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x7:0x0]: returning size 0 00000004:00080000:1.0:1762166759.756960:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x13:0x0], index 0: 0 00010000:00010000:1.0:1762166759.757021:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.757029:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.757041:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.757048:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166759.757052:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.757059:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.757068:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738400) 00010000:00010000:1.0:1762166759.757071:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166759.757074:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.757080:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0af6e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.757110:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0af67 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a8 expref: 20 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.757119:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:1.0:1762166759.757122:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166759.757126:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0af67 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76a8 expref: 20 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.757134:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a000, rc 0) 00000100:00100000:1.0:1762166759.757166:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:38407:x1847765440001280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1685us (1763us total) trans 4294967375 rc 301/301 00000100:00100000:1.0:1762166759.757173:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2526 00000100:00100000:3.0:1762166759.757883:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.757915:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440001664 00000100:00100000:1.0:1762166759.757919:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440001664 00000100:00100000:1.0:1762166759.757953:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 722 00000100:00100000:1.0:1762166759.757960:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:38407:x1847765440001664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166759.758074:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:38407:x1847765440001664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 112us (189us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1762166759.758082:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 722 00000100:00100000:2.0:1762166759.758694:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.758731:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440001792 00000100:00100000:1.0:1762166759.758735:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440001792 00000100:00100000:1.0:1762166759.758763:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2527 00000100:00100000:1.0:1762166759.758771:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:38407:x1847765440001792:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.758781:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.758790:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0af7c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76af expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.758834:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.758844:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.758851:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.758867:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.758873:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 21 pid: 12357 timeout: 478 lvb_type: 0 00000100:00100000:1.0:1762166759.758891:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446784768:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166759.758932:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.759534:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446784768:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166759.759544:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166759.759710:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.759749:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440001920 00000100:00100000:0.0:1762166759.759754:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440001920 00010000:00010000:0.0:1762166759.759770:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 22 pid: 12357 timeout: 478 lvb_type: 0 00000100:00100000:0.0:1762166759.759792:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 595 00000100:00100000:0.0:1762166759.759800:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:2418:x1847765440001920:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166759.759809:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166759.759814:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 22 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1762166759.759834:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 22 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1762166759.759844:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0af44 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b769a expref: 22 pid: 12357 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1762166759.759852:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:0.0:1762166759.759855:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.759860:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.759863:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.759877:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166759.759897:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:2418:x1847765440001920:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.759902:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 595 00010000:00010000:1.0:1762166759.759903:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.759912:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.759947:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00000004:00200000:1.0:1762166759.759953:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166759.759966:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.759987:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0af7c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76af expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.759999:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76af expref: 20 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.760007:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.760009:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166759.760012:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cadc00, rc 0) 00000100:00100000:1.0:1762166759.760054:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:38407:x1847765440001792:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1280us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.760071:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2527 00000100:00100000:2.0:1762166759.760876:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.760919:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440002048 00000100:00100000:1.0:1762166759.760924:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440002048 00000100:00100000:1.0:1762166759.760963:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2528 00000100:00100000:1.0:1762166759.760970:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:38407:x1847765440002048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.760980:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.760989:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0af8a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76b6 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.761019:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0af91 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.761028:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0af91 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.761035:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0af91 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.761052:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x7:0x0]: returning size 0 00000004:00200000:1.0:1762166759.761055:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166759.761075:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0af91 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.761091:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0af8a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76b6 expref: 22 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.761103:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0af91 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76b6 expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.761110:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:1.0:1762166759.761119:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166759.761122:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00000100:00100000:1.0:1762166759.761152:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:38407:x1847765440002048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 182us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.761159:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2528 00000100:00100000:3.0:1762166759.761932:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.761981:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440002176 00000100:00100000:0.0:1762166759.761986:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440002176 00000100:00100000:0.0:1762166759.762035:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 905 00000100:00080000:1.0:1762166759.762036:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166759.762047:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2417:x1847765440002176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166759.762056:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166759.762068:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76bd expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166759.762139:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166759.762157:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.762159:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.762166:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 8 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166759.762178:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 8 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166759.762187:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2a00, rc 0) 00000100:00100000:0.0:1762166759.762216:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2417:x1847765440002176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 172us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.762223:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 905 00000100:00100000:3.0:1762166759.763103:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.763133:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440002432 00000100:00100000:1.0:1762166759.763138:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440002432 00000100:00100000:1.0:1762166759.763162:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2529 00000100:00100000:1.0:1762166759.763168:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:38407:x1847765440002432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.763175:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.763182:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0af9f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76c4 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.763220:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0afa6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.763228:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0afa6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.763233:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0afa6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.763239:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00010000:00010000:1.0:1762166759.763284:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0af9f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76c4 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.763293:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0afa6 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76c4 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.763297:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.763304:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166759.763306:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cacc00, rc 0) 00000100:00100000:1.0:1762166759.763330:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:38407:x1847765440002432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 162us (228us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1762166759.763334:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2529 00000100:00100000:2.0:1762166759.764455:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.764509:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440002560 00000100:00100000:0.0:1762166759.764514:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440002560 00000100:00100000:0.0:1762166759.764542:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 906 00000100:00100000:0.0:1762166759.764551:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2418:x1847765440002560:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166759.764574:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.764586:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 13 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.764593:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166759.764595:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166759.764598:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.764623:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 13 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.764640:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 13 pid: 8382 timeout: 478 lvb_type: 0 00000100:00100000:0.0:1762166759.764651:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446784896:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166759.764701:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.765376:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446784896:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166759.765389:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.769866:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.769918:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440002688 00000100:00100000:0.0:1762166759.769925:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440002688 00010000:00010000:0.0:1762166759.769962:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 14 pid: 8382 timeout: 478 lvb_type: 0 00000100:00100000:0.0:1762166759.769988:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 596 00000100:00100000:0.0:1762166759.769995:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2418:x1847765440002688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166759.770006:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1762166759.770018:0:8398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:0.0:1762166759.770020:0:8398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb mtime from disk: 0 -> 1762166759 00002000:00010000:0.0:1762166759.770022:0:8398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb ctime from disk: 0 -> 1762166759 00002000:00010000:0.0:1762166759.770023:0:8398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb blocks from disk: 0 -> 20480 00010000:00010000:0.0:1762166759.770028:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 14 pid: 8382 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1762166759.770050:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 14 pid: 8382 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1762166759.770066:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0af36 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7693 expref: 14 pid: 8382 timeout: 478 lvb_type: 0 00010000:00010000:0.0:1762166759.770080:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.770082:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.770086:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.770095:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.770119:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166759.770144:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.770153:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.770158:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2418:x1847765440002688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.770166:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 596 00010000:00010000:3.0:1762166759.770175:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.770190:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.770195:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.770200:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166759.770203:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.770208:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.770216:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.770221:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0afb4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166759.770264:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:2418:x1847765440002560:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 5715us (5809us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.770313:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 906 00000100:00100000:2.0:1762166759.771124:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166759.771152:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440002816 00000100:00100000:3.0:1762166759.771156:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440002816 00000100:00100000:3.0:1762166759.771179:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 907 00000100:00100000:3.0:1762166759.771184:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:2416:x1847765440002816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166759.771198:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166759.771207:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76cb expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166759.771216:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x12:0x0] initial LVB size: 10485760, mtime: 0x690887e7, atime: 0x0, ctime: 0x690887e7, blocks: 0x5000 00010000:00010000:3.0:1762166759.771225:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166759.771226:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166759.771229:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 13 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166759.771237:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 13 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166759.771243:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb800, rc 0) 00000100:00100000:3.0:1762166759.771265:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2416:x1847765440002816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.771269:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 907 00000100:00100000:2.0:1762166759.792740:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166759.792799:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440002944 00000100:00100000:3.0:1762166759.792809:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440002944 00000100:00100000:3.0:1762166759.792851:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 908 00000100:00100000:3.0:1762166759.792858:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765440002944:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166759.792964:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765440002944:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 106us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.792969:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 908 00000100:00100000:1.0:1762166759.796546:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.796596:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.796631:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166759.796650:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440003200 00000100:00100000:0.0:1762166759.796650:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440003072 00000100:00100000:3.0:1762166759.796661:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440003200 00000100:00100000:0.0:1762166759.796661:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440003072 00000100:00100000:0.0:1762166759.796733:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440003328 00000100:00100000:0.0:1762166759.796740:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440003328 00000100:00100000:3.0:1762166759.796756:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 440 00000100:00100000:1.0:1762166759.796779:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 441 00000100:00100000:3.0:1762166759.796783:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2418:x1847765440003072:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:1.0:1762166759.796788:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2418:x1847765440003200:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166759.796819:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 442 00010000:00010000:3.0:1762166759.796823:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.796823:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.796828:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2419:x1847765440003328:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166759.796847:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166759.796850:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.796850:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.796859:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.796883:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166759.796885:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.796886:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166759.796889:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.796899:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.796899:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.796904:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.796911:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.796923:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.803707:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.803731:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.803741:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.803820:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166759.803824:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.803831:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.803852:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.803862:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0afd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166759.803953:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2419:x1847765440003328:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 7111us (7306us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1762166759.803964:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 442 00010000:00010000:2.0:1762166759.809391:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.809422:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.809430:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.809438:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166759.809444:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.809463:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.809530:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.809540:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0afc2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.809652:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2418:x1847765440003200:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 12859us (13050us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1762166759.809665:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 441 00010000:00010000:3.0:1762166759.814348:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.814362:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.814368:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.814372:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166759.814375:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.814380:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.814392:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.814396:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0afc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166759.814474:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2418:x1847765440003072:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 17690us (17939us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1762166759.814510:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 440 00000100:00100000:1.0:1762166759.819470:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166759.819544:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440003456 00000100:00100000:2.0:1762166759.819557:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440003456 00000100:00100000:2.0:1762166759.819614:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2530 00000100:00100000:2.0:1762166759.819623:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:38407:x1847765440003456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166759.819649:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166759.819669:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c58800/0x2f180c4effb0afd7 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76d2 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.819700:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 3/1,0 mode: --/PR res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166759.819713:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.819723:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.819857:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c58800/0x2f180c4effb0afd7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.819871:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.819877:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:2.0:1762166759.819880:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166759.819882:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5c59a00, rc 0) 00000100:00100000:2.0:1762166759.819952:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38407:x1847765440003456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 329us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166759.819963:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2530 00000100:00100000:2.0:1762166759.824364:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166759.824418:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440003584 00000100:00100000:3.0:1762166759.824431:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440003584 00000100:00100000:3.0:1762166759.824512:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 443 00000100:00100000:3.0:1762166759.824521:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765440003584:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166759.824547:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.824561:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 8 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166759.824567:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166759.824569:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166759.824571:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.824597:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 8 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166759.824605:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 8 pid: 9168 timeout: 478 lvb_type: 1 00000100:00100000:3.0:1762166759.824615:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765446785024:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166759.824689:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6021300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.825605:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166759.825630:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765446785024:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166759.825651:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.825653:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440003712 00000100:00100000:2.0:1762166759.825659:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440003712 00000100:00100000:2.0:1762166759.825701:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 444 00000100:00100000:2.0:1762166759.825711:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765440003712:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166759.825731:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.825739:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.825741:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.825743:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.825749:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.825789:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166759.825826:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440003968 00000100:00100000:2.0:1762166759.825830:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440003968 00010000:00010000:2.0:1762166759.825845:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 10 pid: 9168 timeout: 478 lvb_type: 1 00000100:00100000:2.0:1762166759.825867:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 597 00000100:00100000:2.0:1762166759.825874:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2416:x1847765440003968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166759.825881:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166759.825896:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 10 pid: 9168 timeout: 478 lvb_type: 1 00010000:00010000:2.0:1762166759.825904:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 10 pid: 9168 timeout: 478 lvb_type: 1 00010000:00010000:2.0:1762166759.825919:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0af98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76bd expref: 10 pid: 9168 timeout: 478 lvb_type: 1 00010000:00010000:2.0:1762166759.825931:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.825933:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.825947:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.825956:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.825964:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.825971:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.825974:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.825978:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.826001:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.826041:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.826043:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2416:x1847765440003968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 161us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166759.826050:0:23942:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.826076:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.826086:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.826086:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 597 00000100:00100000:0.0:1762166759.826287:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166759.826317:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440003840 00000100:00100000:2.0:1762166759.826321:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440003840 00000100:00100000:2.0:1762166759.826366:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 445 00000100:00100000:2.0:1762166759.826378:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765440003840:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166759.826395:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.826405:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.826406:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.826410:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.826420:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166759.842003:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836649 is committed 00000001:00080000:1.0:1762166759.842022:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836648 is committed 00000001:00080000:1.0:1762166759.842031:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836646 is committed 00002000:00010000:0.0:1762166759.842177:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:0.0:1762166759.842186:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1762166760 00002000:00010000:0.0:1762166759.842189:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1762166760 00002000:00010000:0.0:1762166759.842192:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:0.0:1762166759.842205:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.842223:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.842232:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.842240:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5c59c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166759.842244:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.842265:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.842284:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.842292:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59c00/0x2f180c4effb0aff3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.842374:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765440003840:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 15995us (16082us total) trans 21474836649 rc 0/0 00000100:00100000:0.0:1762166759.842385:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 445 00000001:00080000:3.0:1762166759.850896:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836651 is committed 00002000:00010000:1.0:1762166759.851207:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb blocks from disk: 4096 -> 20480 00010000:00010000:1.0:1762166759.851230:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.851242:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.851253:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.851262:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.851273:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.851286:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.851287:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5c58a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166759.851295:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166759.851302:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.851303:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.851328:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.851331:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.851355:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.851356:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.851407:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5c58a00/0x2f180c4effb0afec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.851408:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0afe5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.851550:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765440003584:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 27026us (27191us total) trans 21474836651 rc 0/0 00000100:00100000:2.0:1762166759.851558:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 443 00000100:00100000:1.0:1762166759.851570:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765440003712:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 25857us (25963us total) trans 21474836650 rc 0/0 00000100:00100000:1.0:1762166759.851590:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 444 00000100:00100000:2.0:1762166759.855696:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.855750:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440004096 00000100:00100000:1.0:1762166759.855761:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440004096 00000100:00100000:1.0:1762166759.855817:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2531 00000100:00100000:1.0:1762166759.855824:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38407:x1847765440004096:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166759.856841:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967377 is committed 00000020:00080000:3.0:1762166759.856858:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf785cd80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1762166759.856862:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37bee00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf785c240 00000020:00080000:3.0:1762166759.856865:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].6 00000020:00080000:3.0:1762166759.856867:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37bef00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4680400 00000020:00080000:3.0:1762166759.856869:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].6 00010000:00010000:2.0:1762166759.856870:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166759.856879:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166759.856881:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 5 batchid updated 00010000:00010000:2.0:1762166759.856888:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166759.856903:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166759.856908:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:0.0:1762166759.856914:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 6 committed batchid 5 00010000:00010000:2.0:1762166759.856915:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166759.856951:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:2.0:1762166759.856954:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166759.856958:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166759.856963:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0aed4 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166759.856978:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.856982:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.856987:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.856991:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3c9e600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166759.856994:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.856997:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.857003:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x3d8b1ba3 (ffff945cf39a3e00) 00010000:00010000:2.0:1762166759.857011:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166759.857015:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166759.857019:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3c9e600/0x2f180c4effb0af21 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000004:00080000:0.0:1762166759.857049:0:7435:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945cf1fbe240 with version 14 00000100:00100000:1.0:1762166759.857060:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:38407:x1847765440004096:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1234us (1366us total) trans 0 rc 0/0 00000020:00080000:0.0:1762166759.857069:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 5 cancel update log [0x200000401:0x2:0x0].5: rc = 0 00000100:00100000:1.0:1762166759.857070:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2531 00000004:00080000:3.0:1762166759.857107:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 14 rpc_version 14 00000020:00080000:0.0:1762166759.857124:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 5 cancel update log [0x240000400:0x2:0x0].5: rc = 0 00000020:00100000:3.0:1762166759.857141:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1762166759.857141:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 5 00000100:00100000:3.0:1762166759.857155:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945cf3db4380 x1847765446785280/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166759.857175:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446785280:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1762166759.857250:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166759.857291:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6021300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166759.857291:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446785280 00000100:00100000:2.0:1762166759.857300:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446785280 00000100:00100000:2.0:1762166759.857340:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1762166759.857348:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7425:x1847765446785280:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166759.857470:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7425:x1847765446785280:12345-0@lo:1000:osp_up0-1.0 Request processed in 123us (219us total) trans 4294968850 rc 0/0 00000100:00100000:2.0:1762166759.857503:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1762166759.857536:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446785280:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1762166759.857915:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.857982:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440004224 00000100:00100000:0.0:1762166759.857989:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440004224 00000100:00100000:0.0:1762166759.858036:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 909 00000100:00100000:0.0:1762166759.858045:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2419:x1847765440004224:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166759.858118:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:2419:x1847765440004224:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.858126:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 909 00000100:00100000:2.0:1762166759.863986:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.864050:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440004352 00000100:00100000:0.0:1762166759.864078:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440004352 00000100:00100000:0.0:1762166759.864128:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 910 00000100:00100000:0.0:1762166759.864137:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765440004352:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166759.864177:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864191:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.864192:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.864197:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864210:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864231:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864236:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864242:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864246:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166759.864249:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864254:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864271:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.864276:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0affa lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.864334:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765440004352:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 200us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.864340:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 910 00000100:00100000:2.0:1762166759.865250:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.865299:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440004608 00000100:00100000:1.0:1762166759.865306:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440004608 00000100:00100000:1.0:1762166759.865340:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2532 00000100:00100000:1.0:1762166759.865346:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:38407:x1847765440004608:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166759.865390:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166759.865410:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0af91 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76b6 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.865423:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:1.0:1762166759.865426:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.865447:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.865457:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.865463:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00010000:1.0:1762166759.865615:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000020c04e54 reply state 0000000099739188 transno 4294967378 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.865631:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.865636:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:1.0:1762166759.865638:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166759.865640:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166759.865709:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38407:x1847765440004608:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 362us (460us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1762166759.865715:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2532 00000100:00100000:3.0:1762166759.866525:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.866559:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440004736 00000100:00100000:1.0:1762166759.866565:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440004736 00000100:00100000:1.0:1762166759.866596:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2533 00000100:00100000:1.0:1762166759.866603:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38407:x1847765440004736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.866618:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.866628:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76d9 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.866659:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.866670:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.866688:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:1.0:1762166759.866691:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166759.866694:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5400, rc 0) 00000100:00100000:1.0:1762166759.866724:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440004736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 122us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.866737:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2533 00000100:00100000:2.0:1762166759.867489:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.867518:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440004864 00000100:00100000:0.0:1762166759.867523:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440004864 00000100:00100000:0.0:1762166759.867555:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 911 00000100:00100000:0.0:1762166759.867561:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+6:38407:x1847765440004864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166759.867569:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166759.867582:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76e0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166759.867599:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 10485760, mtime: 0x690887e8, atime: 0x0, ctime: 0x690887e8, blocks: 0x5000 00010000:00010000:0.0:1762166759.867609:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.867611:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.867615:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 7 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.867625:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 7 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.867641:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2a00, rc 0) 00000100:00100000:0.0:1762166759.867666:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:38407:x1847765440004864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 106us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.867671:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 911 00000100:00100000:2.0:1762166759.868350:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.868395:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440004992 00000100:00100000:0.0:1762166759.868400:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440004992 00000100:00100000:0.0:1762166759.868428:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 912 00000100:00100000:0.0:1762166759.868436:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765440004992:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166759.868566:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:0.0:1762166759.868570:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb mtime from disk: 1762166760 -> 1762166759 00002000:00010000:0.0:1762166759.868573:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb atime from disk: 0 -> 1762166759 00002000:00010000:0.0:1762166759.868576:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb ctime from disk: 1762166760 -> 1762166760 00002000:00010000:0.0:1762166759.868578:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb blocks from disk: 20480 -> 20480 00000100:00100000:0.0:1762166759.868609:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765440004992:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 173us (258us total) trans 21474836652 rc 0/0 00000100:00100000:0.0:1762166759.868616:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 912 00000100:00100000:2.0:1762166759.869228:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.869266:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440005248 00000100:00100000:1.0:1762166759.869271:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440005248 00000100:00100000:1.0:1762166759.869303:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2534 00000100:00100000:1.0:1762166759.869311:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440005248:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166759.869349:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.869362:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.869370:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.869403:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.869419:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 16 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166759.869435:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446785408:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166759.869555:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.870176:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446785408:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166759.870195:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166759.870398:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.870448:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440005376 00000100:00100000:0.0:1762166759.870453:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440005376 00010000:00010000:0.0:1762166759.870495:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166759.870528:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 598 00000100:00100000:0.0:1762166759.870537:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2419:x1847765440005376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166759.870549:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166759.870565:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.870576:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.870595:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5c59a00/0x2f180c4effb0afde lrc: 0/0,0 mode: --/PR res: [0x240000403:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d2 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.870608:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:0.0:1762166759.870612:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.870620:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.870627:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.870649:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.870662:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.870681:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:0.0:1762166759.870682:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:2419:x1847765440005376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 145us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.870696:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 598 00010000:00010000:1.0:1762166759.870711:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.870717:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.870721:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.870728:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166759.870731:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.870737:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.870744:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:1.0:1762166759.870747:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166759.870750:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 2/0,0 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.870754:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b016 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166759.870786:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38407:x1847765440005248:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1476us (1558us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166759.870790:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2534 00000100:00100000:2.0:1762166759.871449:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.871500:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440005632 00000100:00100000:1.0:1762166759.871505:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440005632 00000100:00100000:1.0:1762166759.871533:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2535 00000100:00100000:1.0:1762166759.871539:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38407:x1847765440005632:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166759.871569:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166759.871579:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0af83 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76af expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.871587:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.871590:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.871615:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.871621:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.871626:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00010000:1.0:1762166759.871693:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000588f5a5c reply state 0000000023c38583 transno 4294967379 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.871701:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.871705:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.871706:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166759.871708:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166759.871749:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440005632:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 210us (300us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1762166759.871753:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2535 00000100:00100000:2.0:1762166759.872513:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.872540:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440005760 00000100:00100000:1.0:1762166759.872545:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440005760 00000100:00100000:1.0:1762166759.872595:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2536 00000100:00100000:1.0:1762166759.872604:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440005760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.872620:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.872632:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76e7 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.872667:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.872680:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.872695:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.872698:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166759.872701:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4400, rc 0) 00000100:00100000:1.0:1762166759.872729:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440005760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 127us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.872733:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2536 00000100:00100000:2.0:1762166759.873556:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.873578:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440005888 00000100:00100000:0.0:1762166759.873584:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440005888 00000100:00100000:0.0:1762166759.873623:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 913 00000100:00100000:0.0:1762166759.873634:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:38407:x1847765440005888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166759.873645:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166759.873658:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b02b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76ee expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.873693:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 14 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166759.873701:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.873703:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.873707:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b02b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76ee expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.873731:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 14 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166759.873740:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 14 pid: 9168 timeout: 479 lvb_type: 1 00000100:00100000:0.0:1762166759.873751:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446785536:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166759.873795:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.874541:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446785536:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166759.874567:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b02b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76ee expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.874580:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3000, rc 0) 00000100:00100000:0.0:1762166759.874614:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:38407:x1847765440005888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 984us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.874622:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 913 00000100:00100000:0.0:1762166759.874729:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166759.874789:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440006016 00000100:00100000:2.0:1762166759.874795:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440006016 00010000:00010000:2.0:1762166759.874814:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 14 pid: 9168 timeout: 479 lvb_type: 1 00000100:00100000:2.0:1762166759.874842:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 599 00000100:00100000:2.0:1762166759.874859:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2419:x1847765440006016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166759.874869:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166759.874889:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 14 pid: 9168 timeout: 479 lvb_type: 1 00010000:00010000:2.0:1762166759.874901:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 14 pid: 9168 timeout: 479 lvb_type: 1 00010000:00010000:2.0:1762166759.874919:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0afbb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76cb expref: 14 pid: 9168 timeout: 479 lvb_type: 1 00010000:00010000:2.0:1762166759.874931:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.874933:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.874950:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b02b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76ee expref: 13 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.874960:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b02b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76ee expref: 13 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.874987:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b02b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76ee expref: 13 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.874999:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446785664:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166759.875045:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.875792:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446785664:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166759.875807:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166759.875844:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765440006016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 987us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.875853:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 599 00000100:00100000:2.0:1762166759.876004:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.876042:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440006144 00000100:00100000:0.0:1762166759.876048:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440006144 00000100:00100000:0.0:1762166759.876082:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 914 00000100:00100000:0.0:1762166759.876091:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+13:2419:x1847765440006144:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166759.876224:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:0.0:1762166759.876229:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb mtime from disk: 1762166759 -> 1762166759 00002000:00010000:0.0:1762166759.876231:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb atime from disk: 0 -> 1762166759 00002000:00010000:0.0:1762166759.876234:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb ctime from disk: 1762166759 -> 1762166760 00002000:00010000:0.0:1762166759.876237:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x12:0x0] updating lvb blocks from disk: 20480 -> 20480 00000100:00100000:0.0:1762166759.876267:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2419:x1847765440006144:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 178us (266us total) trans 17179869334 rc 0/0 00000100:00100000:0.0:1762166759.876275:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 914 00000100:00100000:3.0:1762166759.876993:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.877035:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440006400 00000100:00100000:1.0:1762166759.877040:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440006400 00000100:00100000:1.0:1762166759.877071:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 723 00000100:00100000:1.0:1762166759.877076:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440006400:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166759.877124:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000403:0x6:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0afa6 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76c4 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.877153:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166759.877165:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.877187:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.877213:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.877221:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166759.877231:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446785792:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166759.877271:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.877929:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446785792:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166759.877952:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166759.878091:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.878126:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440006528 00000100:00100000:0.0:1762166759.878130:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440006528 00010000:00010000:0.0:1762166759.878146:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166759.878171:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 600 00000100:00100000:0.0:1762166759.878176:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:2418:x1847765440006528:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166759.878184:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166759.878189:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.878203:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.878214:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b024 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e7 expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.878224:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:0.0:1762166759.878227:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.878233:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.878237:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.878252:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.878275:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166759.878279:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2418:x1847765440006528:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 102us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.878284:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 600 00010000:00010000:1.0:1762166759.878298:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.878316:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166759.878327:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.878335:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.878365:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.878372:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 16 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166759.878379:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446785920:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166759.878422:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.879063:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446785920:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166759.879093:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166759.879220:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.879263:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440006656 00000100:00100000:0.0:1762166759.879269:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440006656 00010000:00010000:0.0:1762166759.879287:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166759.879314:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 601 00000100:00100000:0.0:1762166759.879325:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2418:x1847765440006656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166759.879334:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166759.879345:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.879355:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.879369:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b008 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76d9 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.879379:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:0.0:1762166759.879384:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.879391:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.879398:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.879416:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.879436:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.879444:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166759.879456:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:2418:x1847765440006656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.879466:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 601 00000100:00100000:1.0:1762166759.879711:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446786048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166759.879756:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.879784:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166759.879801:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446786048 00000100:00100000:2.0:1762166759.879812:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446786048 00000100:00100000:2.0:1762166759.879843:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1762166759.879847:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446786048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166759.879957:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446786048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166759.879964:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1762166759.879997:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446786048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166759.880079:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446786176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166759.880108:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.880127:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd1ae63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166759.880146:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446786176 00000100:00100000:2.0:1762166759.880150:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446786176 00000100:00100000:2.0:1762166759.880181:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00080000:1.0:1762166759.880185:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166759.880186:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446786176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166759.880246:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446786176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166759.880254:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1762166759.880270:0:6498:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836648 gen 2 00000004:00080000:1.0:1762166759.880280:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406c380, transno 21474836647 00000004:00080000:1.0:1762166759.880293:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406ce00, transno 21474836648 00000100:00100000:1.0:1762166759.880298:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446786176:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:1.0:1762166759.880438:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].7, 280 off39824 00000001:00080000:1.0:1762166759.880447:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967380 00000100:00100000:1.0:1762166759.880512:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446786304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166759.880537:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.880556:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166759.880565:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446786304 00000100:00100000:2.0:1762166759.880569:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446786304 00000100:00100000:2.0:1762166759.880591:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1762166759.880596:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446786304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166759.880675:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446786304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (138us total) trans 21474836653 rc 0/0 00000100:00100000:2.0:1762166759.880681:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1762166759.880705:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446786304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166759.880728:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446786432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166759.880755:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166759.880776:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166759.880780:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446786432 00000100:00100000:2.0:1762166759.880784:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446786432 00000100:00100000:2.0:1762166759.880802:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1762166759.880806:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446786432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166759.880866:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6498:x1847765446786432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 59us (110us total) trans 17179869335 rc 0/0 00000100:00100000:2.0:1762166759.880872:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1762166759.880888:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446786432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166759.880930:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967381 00010000:00010000:1.0:1762166759.880965:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.880975:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.880982:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.880988:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166759.880992:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881000:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881017:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:1.0:1762166759.881020:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166759.881025:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881031:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b039 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881042:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881048:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881053:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881059:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166759.881062:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881067:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881073:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.881075:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166759.881077:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881081:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b032 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.881089:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.881095:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166759.881100:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0afa6 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76c4 expref: 18 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166759.881171:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440006400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4094us (4178us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1762166759.881177:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 723 00000020:00080000:1.0:1762166759.881180:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166759.881946:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.881993:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440006784 00000100:00100000:1.0:1762166759.881999:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440006784 00000100:00100000:1.0:1762166759.882042:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2537 00000100:00100000:1.0:1762166759.882051:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440006784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.882067:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.882083:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76f5 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.882126:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 18 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.882139:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 18 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.882155:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.882158:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166759.882161:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:1.0:1762166759.882195:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:38407:x1847765440006784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 146us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.882202:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2537 00000100:00100000:3.0:1762166759.883317:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.883357:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440007040 00000100:00100000:1.0:1762166759.883363:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440007040 00000100:00100000:1.0:1762166759.883398:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 724 00000100:00100000:1.0:1762166759.883406:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:38407:x1847765440007040:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166759.883614:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:38407:x1847765440007040:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 208us (300us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1762166759.883622:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 724 00000100:00100000:2.0:1762166759.884308:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.884349:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440007296 00000100:00100000:1.0:1762166759.884354:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440007296 00000100:00100000:1.0:1762166759.884383:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 725 00000100:00100000:1.0:1762166759.884389:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:38407:x1847765440007296:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166759.884519:0:6498:0:(mdd_object.c:3965:mdd_close()) Object [0x240000403:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166759.884588:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166759.884597:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.884605:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.884612:0:6498:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.884616:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.884619:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166759.884636:0:6498:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166759.884655:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166759.884663:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.884670:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166759.884674:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.884680:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.884698:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:0.0:1762166759.884700:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166759.884703:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.884707:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b047 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166759.884718:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166759.884721:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166759.884722:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166759.884769:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:38407:x1847765440007296:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 379us (463us total) trans 4294967384 rc 0/0 00000100:00100000:1.0:1762166759.884774:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 725 00000100:00100000:2.0:1762166759.885749:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.885787:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440007552 00000100:00100000:1.0:1762166759.885792:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440007552 00000100:00100000:1.0:1762166759.885820:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2538 00000100:00100000:1.0:1762166759.885828:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:38407:x1847765440007552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.885856:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.885870:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b04e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b76fc expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.885951:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.885961:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.885970:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.885984:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.885991:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.885998:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886076:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b063 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.886082:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b063 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886093:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b063 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.886102:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00010000:00010000:1.0:1762166759.886157:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886162:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886166:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886169:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166759.886172:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886176:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886181:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:1.0:1762166759.886183:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166759.886185:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886189:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b055 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886196:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886200:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886211:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886214:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166759.886216:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886219:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886223:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x3d8b1ba3 (ffff945cd0738d00) 00010000:00010000:1.0:1762166759.886224:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166759.886225:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886228:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b05c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.886257:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b04e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76fc expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.886266:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b063 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76fc expref: 22 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.886269:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.886271:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166759.886272:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2b400, rc 0) 00000100:00100000:1.0:1762166759.886302:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:38407:x1847765440007552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 477us (555us total) trans 4294967385 rc 0/0 00000100:00100000:1.0:1762166759.886307:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2538 00000100:00100000:3.0:1762166759.887371:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.887406:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440007808 00000100:00100000:1.0:1762166759.887411:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440007808 00000100:00100000:1.0:1762166759.887453:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2539 00000100:00100000:1.0:1762166759.887473:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+22:38407:x1847765440007808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.887521:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.887532:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b071 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7703 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.887858:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.887869:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.887878:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.887887:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x8:0x0]: returning size 0 00010000:00010000:1.0:1762166759.887918:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b071 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.887932:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.887953:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738b00) 00010000:00010000:1.0:1762166759.887956:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166759.887959:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2a000, rc 0) 00000100:00100000:1.0:1762166759.888003:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38407:x1847765440007808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 536us (635us total) trans 4294967386 rc 0/0 00000100:00100000:1.0:1762166759.888010:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2539 00000100:00100000:2.0:1762166759.889159:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.889190:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440008064 00000100:00100000:1.0:1762166759.889195:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440008064 00000100:00100000:1.0:1762166759.889223:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2540 00000100:00100000:1.0:1762166759.889228:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38407:x1847765440008064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.889241:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.889250:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b086 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b770a expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.889304:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.889313:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.889319:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 4/0,1 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.889351:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.889366:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 25 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166759.889382:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446786560:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166759.889447:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166759.890227:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446786560:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166759.890248:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166759.890540:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.890603:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440008192 00000100:00100000:0.0:1762166759.890618:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440008192 00010000:00010000:0.0:1762166759.890668:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 26 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166759.890711:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 602 00000100:00100000:0.0:1762166759.890719:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:2419:x1847765440008192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166759.890731:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166759.890736:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 26 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.890747:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 26 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.890766:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a000/0x2f180c4effb0b078 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7703 expref: 26 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.890782:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738b00) 00010000:00010000:0.0:1762166759.890800:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.890808:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.890815:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.890846:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.890864:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.890883:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.890897:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x8:0x0]: returning size 0 00000100:00100000:0.0:1762166759.890906:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2419:x1847765440008192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.890913:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 602 00000004:00080000:1.0:1762166759.891074:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x13:0x0], index 1: 0 00010000:00010000:1.0:1762166759.891169:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.891178:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.891184:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.891190:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166759.891194:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.891201:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.891214:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738b00) 00010000:00010000:1.0:1762166759.891217:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166759.891221:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 2/0,0 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.891227:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b08d lrc: 0/0,0 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.891275:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b086 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b770a expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.891296:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:1.0:1762166759.891298:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166759.891303:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b086 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b770a expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.891312:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2b200, rc 0) 00000100:00100000:1.0:1762166759.891355:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38407:x1847765440008064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2125us (2199us total) trans 4294967387 rc 301/301 00000100:00100000:1.0:1762166759.891364:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2540 00000100:00100000:2.0:1762166759.892129:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.892170:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440008448 00000100:00100000:1.0:1762166759.892176:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440008448 00000100:00100000:1.0:1762166759.892204:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 726 00000100:00100000:1.0:1762166759.892210:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38407:x1847765440008448:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166759.892359:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:38407:x1847765440008448:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 149us (232us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1762166759.892365:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 726 00000100:00100000:2.0:1762166759.893291:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.893337:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440008576 00000100:00100000:1.0:1762166759.893342:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440008576 00000100:00100000:1.0:1762166759.893370:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2541 00000100:00100000:1.0:1762166759.893377:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:38407:x1847765440008576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.893391:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.893409:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b09b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7711 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.893465:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b0a2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.893526:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.893534:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.893561:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x8:0x0]: returning size 0 00000004:00200000:1.0:1762166759.893564:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166759.893575:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b0a2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.893594:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b09b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7711 expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.893605:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b0a2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7711 expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.893611:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166759.893613:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166759.893615:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2a200, rc 0) 00000100:00100000:1.0:1762166759.893645:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:38407:x1847765440008576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 270us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.893650:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2541 00000100:00100000:2.0:1762166759.894544:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.894582:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440008704 00000100:00100000:0.0:1762166759.894591:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440008704 00000100:00100000:0.0:1762166759.894635:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 915 00000100:00100000:0.0:1762166759.894644:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+14:2419:x1847765440008704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166759.894657:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166759.894672:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7718 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166759.894774:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166759.894793:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.894795:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.894802:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166759.894818:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166759.894845:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2800, rc 0) 00000100:00100000:0.0:1762166759.894901:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2419:x1847765440008704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 258us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166759.894908:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 915 00000100:00100000:2.0:1762166759.895946:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.895991:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440008960 00000100:00100000:1.0:1762166759.895998:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440008960 00000100:00100000:1.0:1762166759.896042:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2542 00000100:00100000:1.0:1762166759.896050:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:38407:x1847765440008960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.896065:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.896079:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0b0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b771f expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.896180:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b0b7 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.896190:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b0b7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.896197:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b0b7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166759.896206:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00010000:00010000:1.0:1762166759.896300:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0b0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b771f expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.896312:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b771f expref: 28 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.896318:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166759.896320:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166759.896322:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2b800, rc 0) 00000100:00100000:1.0:1762166759.896365:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+28:38407:x1847765440008960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 315us (433us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1762166759.896373:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2542 00000100:00100000:2.0:1762166759.897432:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.897505:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440009088 00000100:00100000:0.0:1762166759.897514:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440009088 00000100:00100000:0.0:1762166759.897549:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 916 00000100:00100000:0.0:1762166759.897555:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765440009088:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166759.897583:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.897594:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 8 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.897599:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166759.897601:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166759.897603:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.897627:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 8 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.897637:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 8 pid: 9168 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166759.897647:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446786688:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166759.897712:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166759.898506:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446786688:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166759.898526:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.898680:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.898734:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440009216 00000100:00100000:0.0:1762166759.898740:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440009216 00010000:00010000:0.0:1762166759.898763:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 9 pid: 9168 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166759.898789:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 603 00000100:00100000:0.0:1762166759.898794:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765440009216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166759.898805:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166759.898822:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 9 pid: 9168 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.898832:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 9 pid: 9168 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.898853:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b00f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76e0 expref: 9 pid: 9168 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166759.898863:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.898865:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.898868:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.898885:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.898908:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166759.898946:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.898954:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765440009216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 157us (273us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166759.898960:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.898966:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 603 00010000:00010000:3.0:1762166759.898986:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.898994:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.898999:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.899004:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166759.899008:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.899014:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.899031:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.899050:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b0c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166759.899144:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765440009088:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1589us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.899151:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 916 00000100:00100000:2.0:1762166759.920995:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166759.921075:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440009344 00000100:00100000:3.0:1762166759.921090:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440009344 00000100:00100000:3.0:1762166759.921145:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 917 00000100:00100000:3.0:1762166759.921152:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765440009344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166759.921168:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166759.921186:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7726 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166759.921203:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 10485760, mtime: 0x690887e7, atime: 0x690887e7, ctime: 0x690887e8, blocks: 0x5000 00010000:00010000:3.0:1762166759.921217:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166759.921219:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166759.921224:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 8 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166759.921236:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 8 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166759.921245:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb000, rc 0) 00000100:00100000:3.0:1762166759.921298:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765440009344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 147us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.921315:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 917 00000100:00100000:2.0:1762166759.922364:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166759.922405:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440009472 00000100:00100000:3.0:1762166759.922410:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440009472 00000100:00100000:3.0:1762166759.922441:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 918 00000100:00100000:3.0:1762166759.922447:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2416:x1847765440009472:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166759.922537:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2416:x1847765440009472:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 90us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166759.922543:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 918 00000100:00100000:2.0:1762166759.926645:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166759.926682:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.926707:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440009600 00000100:00100000:1.0:1762166759.926716:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440009600 00000100:00100000:0.0:1762166759.926761:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440009728 00000100:00100000:0.0:1762166759.926767:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440009728 00000100:00100000:1.0:1762166759.926804:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 446 00000100:00100000:1.0:1762166759.926818:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765440009600:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166759.926822:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 447 00000100:00100000:3.0:1762166759.926830:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.926839:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765440009728:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166759.926852:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440009856 00010000:00010000:1.0:1762166759.926856:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.926859:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440009856 00010000:00010000:0.0:1762166759.926861:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.926881:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.926885:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.926892:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.926904:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 448 00010000:00010000:1.0:1762166759.926904:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.926905:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.926910:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166759.926916:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166759.926919:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2418:x1847765440009856:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166759.926947:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.926955:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.926967:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.926969:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.926973:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.926983:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.935589:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.935635:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.935678:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.935686:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5c59600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166759.935691:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.935701:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.935732:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.935741:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5c59600/0x2f180c4effb0b0e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.935885:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+12:2418:x1847765440009856:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 8962us (9053us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1762166759.935900:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 448 00010000:00010000:1.0:1762166759.944294:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.944313:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.944322:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.944329:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2ac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166759.944334:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.944342:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.944357:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.944361:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166759.944452:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+10:2419:x1847765440009600:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 17635us (17809us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1762166759.944463:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 446 00010000:00010000:0.0:1762166759.945196:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.945213:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.945222:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.945245:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166759.945249:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.945259:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.945277:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.945285:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.945381:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765440009728:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 18544us (18695us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1762166759.945397:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 447 00000100:00100000:3.0:1762166759.953063:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.953151:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440009984 00000100:00100000:1.0:1762166759.953162:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440009984 00000100:00100000:1.0:1762166759.953222:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2543 00000100:00100000:1.0:1762166759.953233:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+28:38407:x1847765440009984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166759.953258:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166759.953276:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0e8 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b772d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.953310:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 3/1,0 mode: --/PR res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166759.953324:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.953337:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166759.953454:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b0e8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.953472:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.953512:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166759.953516:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166759.953528:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2a600, rc 0) 00000100:00100000:1.0:1762166759.953589:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:38407:x1847765440009984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 357us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.953598:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2543 00000100:00100000:2.0:1762166759.958764:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166759.958879:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440010112 00000100:00100000:0.0:1762166759.958896:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440010112 00000100:00100000:0.0:1762166759.959007:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 449 00000100:00100000:0.0:1762166759.959025:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2417:x1847765440010112:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166759.959069:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.959094:0:16567:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166759.959131:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.959134:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.959138:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.959179:0:16567:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166759.959191:0:16567:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 15 pid: 9168 timeout: 479 lvb_type: 1 00000100:00100000:0.0:1762166759.959204:0:16567:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16567:1847765446786816:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166759.959304:0:16567:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166759.960022:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.960083:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440010240 00000100:00100000:1.0:1762166759.960094:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440010240 00000100:00100000:0.0:1762166759.960157:0:16567:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16567:1847765446786816:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166759.960171:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 450 00010000:00010000:0.0:1762166759.960191:0:16567:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166759.960193:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:2417:x1847765440010240:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:3.0:1762166759.960233:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166759.960240:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.960259:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166759.960262:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166759.960266:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.960276:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.960301:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440010496 00000100:00100000:0.0:1762166759.960309:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440010496 00010000:00010000:0.0:1762166759.960334:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 17 pid: 9168 timeout: 479 lvb_type: 1 00000100:00100000:0.0:1762166759.960372:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 604 00000100:00100000:0.0:1762166759.960381:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2419:x1847765440010496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166759.960397:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166759.960399:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166759.960421:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440010368 00000100:00100000:2.0:1762166759.960426:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440010368 00010000:00010000:0.0:1762166759.960434:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 18 pid: 9168 timeout: 479 lvb_type: 1 00010000:00010000:0.0:1762166759.960449:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 18 pid: 9168 timeout: 479 lvb_type: 1 00000100:00100000:2.0:1762166759.960459:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 451 00000100:00100000:2.0:1762166759.960465:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:2417:x1847765440010368:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166759.960513:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b0a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7718 expref: 18 pid: 9168 timeout: 479 lvb_type: 1 00010000:00010000:2.0:1762166759.960514:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.960537:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.960540:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166759.960547:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166759.960559:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.960559:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.960564:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.960570:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.960580:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.960588:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.960590:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166759.960593:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.960601:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.960636:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166759.960658:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.960670:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.960674:0:16567:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.960688:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2419:x1847765440010496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 305us (453us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166759.960691:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.960705:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 604 00000001:00080000:0.0:1762166759.977961:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869336 is committed 00000001:00080000:0.0:1762166759.977982:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869335 is committed 00002000:00010000:3.0:1762166759.979756:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:3.0:1762166759.979764:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1762166760 00002000:00010000:3.0:1762166759.979767:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1762166760 00002000:00010000:3.0:1762166759.979770:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:3.0:1762166759.979785:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.981257:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.982631:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.982637:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166759.982640:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.982647:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.982756:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166759.982763:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b104 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166759.982884:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c5f20b66-016a-4159-9d62-071c0da3ef0b+11:2417:x1847765440010368:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 22413us (22482us total) trans 17179869336 rc 0/0 00000100:00100000:0.0:1762166759.982894:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 451 00000001:00080000:2.0:1762166759.990946:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869338 is committed 00002000:00010000:1.0:1762166759.991290:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb blocks from disk: 4096 -> 20480 00010000:00010000:0.0:1762166759.991314:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.991328:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.991338:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.991339:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.991371:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.991377:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.991378:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166759.991385:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.991387:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2b200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166759.991393:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.991402:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.991405:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.991441:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.991441:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166759.991458:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b0fd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166759.991460:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b0f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166759.991599:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2417:x1847765440010240:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 31407us (31569us total) trans 17179869337 rc 0/0 00000100:00100000:0.0:1762166759.991599:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2417:x1847765440010112:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 32573us (32836us total) trans 17179869338 rc 0/0 00000100:00100000:1.0:1762166759.991618:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 450 00000100:00100000:0.0:1762166759.991624:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 449 00000100:00100000:2.0:1762166759.997747:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166759.997792:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440010624 00000100:00100000:1.0:1762166759.997803:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440010624 00000100:00100000:1.0:1762166759.997852:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2544 00000100:00100000:1.0:1762166759.997862:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:38407:x1847765440010624:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:2.0:1762166759.999015:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967389 is committed 00000020:00080000:2.0:1762166759.999032:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc402f240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1762166759.999041:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc70b4900 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ceffd4180 00010000:00010000:0.0:1762166759.999044:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00000020:00080000:2.0:1762166759.999046:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc70b4a00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc402f600 00000020:00080000:2.0:1762166759.999051:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc70b4d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3ca1400 00000020:00080000:2.0:1762166759.999057:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].7 00010000:00010000:0.0:1762166759.999061:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999072:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999078:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166759.999083:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999091:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00000020:00080000:2.0:1762166759.999092:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 6 batchid updated 00010000:00010000:0.0:1762166759.999111:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:0.0:1762166759.999115:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166759.999119:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000020:00080000:3.0:1762166759.999123:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 7 committed batchid 6 00010000:00010000:0.0:1762166759.999126:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b001 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999158:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999165:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999172:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999177:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166759.999181:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999194:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999205:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:0.0:1762166759.999209:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166759.999213:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166759.999218:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b01d lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000004:00080000:3.0:1762166759.999226:0:7435:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945bc6021300 with version 15 00000020:00080000:3.0:1762166759.999240:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 6 cancel update log [0x200000401:0x2:0x0].6: rc = 0 00000100:00100000:1.0:1762166759.999241:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38407:x1847765440010624:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1379us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166759.999251:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2544 00000020:00080000:3.0:1762166759.999280:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 6 cancel update log [0x240000400:0x2:0x0].6: rc = 0 00000004:00080000:1.0:1762166759.999285:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 15 rpc_version 15 00000020:00080000:3.0:1762166759.999288:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 6 00000020:00100000:1.0:1762166759.999313:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166759.999323:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc4531880 x1847765446787072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166759.999347:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446787072:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166759.999391:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166759.999425:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446787072 00000100:00100000:3.0:1762166759.999431:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446787072 00000100:00100000:1.0:1762166759.999435:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166759.999537:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1762166759.999545:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7425:x1847765446787072:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1762166759.999652:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7425:x1847765446787072:12345-0@lo:1000:osp_up0-1.0 Request processed in 107us (259us total) trans 4294968851 rc 0/0 00000100:00100000:3.0:1762166759.999666:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1762166759.999695:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446787072:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166760.000561:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.000599:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440010752 00000100:00100000:0.0:1762166760.000605:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440010752 00000100:00100000:0.0:1762166760.000644:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 919 00000100:00100000:0.0:1762166760.000653:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765440010752:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166760.000724:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:2419:x1847765440010752:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.000731:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 919 00000100:00100000:2.0:1762166760.008082:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.008153:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440010880 00000100:00100000:0.0:1762166760.008162:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440010880 00000100:00100000:0.0:1762166760.008201:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 920 00000100:00100000:0.0:1762166760.008208:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2416:x1847765440010880:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166760.008255:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008266:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166760.008268:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166760.008272:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008295:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008315:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008319:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008325:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008329:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166760.008331:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008336:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008345:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.008349:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b10b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166760.008409:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2416:x1847765440010880:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 201us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.008422:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 920 00000100:00100000:2.0:1762166760.009441:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.009494:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440011136 00000100:00100000:1.0:1762166760.009500:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440011136 00000100:00100000:1.0:1762166760.009536:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2545 00000100:00100000:1.0:1762166760.009544:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38407:x1847765440011136:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166760.009583:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166760.009603:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b0a2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7711 expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.009615:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166760.009619:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.009641:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.009652:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.009669:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00010000:1.0:1762166760.009770:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e783c32c reply state 00000000419df3a3 transno 4294967390 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.009782:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.009788:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166760.009791:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166760.009793:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166760.009859:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440011136:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 315us (417us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1762166760.009864:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2545 00000100:00100000:2.0:1762166760.010651:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.010686:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440011264 00000100:00100000:1.0:1762166760.010692:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440011264 00000100:00100000:1.0:1762166760.010720:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2546 00000100:00100000:1.0:1762166760.010729:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440011264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.010741:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.010751:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7734 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.010775:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.010783:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.010803:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166760.010805:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166760.010807:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2ac00, rc 0) 00000100:00100000:1.0:1762166760.010833:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440011264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 105us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.010839:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2546 00000100:00100000:2.0:1762166760.011709:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.011754:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440011392 00000100:00100000:0.0:1762166760.011759:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440011392 00000100:00100000:0.0:1762166760.011799:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 921 00000100:00100000:0.0:1762166760.011809:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+7:38407:x1847765440011392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166760.011818:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166760.011832:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b120 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b773b expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166760.011850:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x13:0x0] initial LVB size: 10485760, mtime: 0x690887e8, atime: 0x0, ctime: 0x0, blocks: 0x5000 00010000:00010000:0.0:1762166760.011864:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166760.011866:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166760.011873:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b773b expref: 8 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.011885:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b773b expref: 8 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.011895:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2800, rc 0) 00000100:00100000:0.0:1762166760.011941:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:38407:x1847765440011392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 125us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.011949:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 921 00000100:00100000:2.0:1762166760.012650:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.012685:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440011520 00000100:00100000:0.0:1762166760.012690:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440011520 00000100:00100000:0.0:1762166760.012726:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 922 00000100:00100000:0.0:1762166760.012735:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2418:x1847765440011520:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166760.012845:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:0.0:1762166760.012849:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb mtime from disk: 1762166760 -> 1762166759 00002000:00010000:0.0:1762166760.012851:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb atime from disk: 0 -> 1762166759 00002000:00010000:0.0:1762166760.012854:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1762166760 00002000:00010000:0.0:1762166760.012856:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x13:0x0] updating lvb blocks from disk: 20480 -> 20480 00000100:00100000:0.0:1762166760.012886:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765440011520:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 154us (237us total) trans 17179869339 rc 0/0 00000100:00100000:0.0:1762166760.012892:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 922 00000100:00100000:2.0:1762166760.013601:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.013643:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440011776 00000100:00100000:1.0:1762166760.013648:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440011776 00000100:00100000:1.0:1762166760.013681:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2547 00000100:00100000:1.0:1762166760.013690:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440011776:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166760.013726:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.013739:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.013747:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.013781:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.013790:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166760.013801:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446787200:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166760.013857:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166760.014616:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446787200:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166760.014633:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166760.014790:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.014832:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440011904 00000100:00100000:0.0:1762166760.014837:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440011904 00010000:00010000:0.0:1762166760.014852:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166760.014873:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 605 00000100:00100000:0.0:1762166760.014878:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:2418:x1847765440011904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166760.014888:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.014892:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.014901:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.014913:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a600/0x2f180c4effb0b0ef lrc: 0/0,0 mode: --/PR res: [0x240000403:0x8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b772d expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.014923:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:0.0:1762166760.014927:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.014950:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.014957:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.014977:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.014994:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.015000:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:0.0:1762166760.015007:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2418:x1847765440011904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.015015:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 605 00010000:00010000:1.0:1762166760.015018:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.015024:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.015028:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.015032:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.015037:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.015044:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.015055:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166760.015068:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166760.015074:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 2/0,0 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.015080:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b127 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166760.015124:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440011776:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1435us (1523us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166760.015136:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2547 00000100:00100000:2.0:1762166760.015795:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.015830:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440012160 00000100:00100000:1.0:1762166760.015835:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440012160 00000100:00100000:1.0:1762166760.015864:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2548 00000100:00100000:1.0:1762166760.015872:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38407:x1847765440012160:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166760.015914:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166760.015927:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b063 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76fc expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.015950:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.015954:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.015980:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.015987:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.015992:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00010000:1.0:1762166760.016052:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c17d9d3c reply state 000000004e5993de transno 4294967391 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.016068:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.016074:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.016076:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166760.016077:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166760.016129:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440012160:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 255us (331us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1762166760.016143:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2548 00000100:00100000:2.0:1762166760.016922:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.016984:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440012288 00000100:00100000:0.0:1762166760.016989:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440012288 00000100:00100000:0.0:1762166760.017020:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 923 00000100:00100000:0.0:1762166760.017027:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:38407:x1847765440012288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166760.017045:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166760.017054:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b135 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7742 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.017071:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 9 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166760.017076:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166760.017077:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166760.017079:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b135 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7742 expref: 9 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.017097:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 9 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166760.017113:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 9 pid: 9168 timeout: 479 lvb_type: 1 00000100:00100000:0.0:1762166760.017123:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446787328:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166760.017167:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166760.017889:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446787328:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166760.017904:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b135 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7742 expref: 9 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.017924:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2a00, rc 0) 00000100:00100000:0.0:1762166760.017977:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:38407:x1847765440012288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 949us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.017984:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 923 00000100:00100000:2.0:1762166760.018212:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.018244:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440012416 00000100:00100000:0.0:1762166760.018248:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440012416 00010000:00010000:0.0:1762166760.018265:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 9 pid: 9168 timeout: 479 lvb_type: 1 00000100:00100000:0.0:1762166760.018289:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 606 00000100:00100000:0.0:1762166760.018296:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ccec70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765440012416:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166760.018310:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.018326:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 9 pid: 9168 timeout: 479 lvb_type: 1 00010000:00010000:0.0:1762166760.018348:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 9 pid: 9168 timeout: 479 lvb_type: 1 00010000:00010000:0.0:1762166760.018363:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b0cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7726 expref: 9 pid: 9168 timeout: 479 lvb_type: 1 00010000:00010000:0.0:1762166760.018371:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166760.018372:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166760.018375:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7742 expref: 8 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.018381:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7742 expref: 8 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.018396:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7742 expref: 8 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166760.018403:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446787456:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166760.018437:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166760.019288:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446787456:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166760.019296:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166760.019322:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ccec70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765440012416:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1027us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.019328:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 606 00000100:00100000:3.0:1762166760.019522:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.019548:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440012544 00000100:00100000:0.0:1762166760.019557:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440012544 00000100:00100000:0.0:1762166760.019586:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 924 00000100:00100000:0.0:1762166760.019594:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+8:2419:x1847765440012544:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166760.019684:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:0.0:1762166760.019686:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb mtime from disk: 1762166759 -> 1762166759 00002000:00010000:0.0:1762166760.019688:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb atime from disk: 1762166759 -> 1762166759 00002000:00010000:0.0:1762166760.019689:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb ctime from disk: 1762166760 -> 1762166760 00002000:00010000:0.0:1762166760.019691:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb blocks from disk: 20480 -> 20480 00000100:00100000:0.0:1762166760.019714:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2419:x1847765440012544:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 122us (240us total) trans 21474836654 rc 0/0 00000100:00100000:0.0:1762166760.019718:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 924 00000100:00100000:2.0:1762166760.020730:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.020765:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440012800 00000100:00100000:1.0:1762166760.020769:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440012800 00000100:00100000:1.0:1762166760.020797:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 727 00000100:00100000:1.0:1762166760.020814:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440012800:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166760.020862:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000403:0x6:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b771f expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.020882:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166760.020889:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.020894:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.020910:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.020920:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166760.020943:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446787584:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166760.020984:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166760.021667:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446787584:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166760.021677:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166760.021883:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.021946:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440012928 00000100:00100000:0.0:1762166760.021951:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440012928 00010000:00010000:0.0:1762166760.021971:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166760.022000:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 607 00000100:00100000:0.0:1762166760.022007:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:2418:x1847765440012928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166760.022017:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.022023:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.022034:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.022047:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b040 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76f5 expref: 18 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.022069:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:0.0:1762166760.022074:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.022081:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.022087:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.022107:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.022130:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.022141:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166760.022142:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2418:x1847765440012928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 132us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.022158:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 607 00010000:00010000:1.0:1762166760.022164:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166760.022177:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.022184:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.022205:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.022216:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 16 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166760.022227:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446787712:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166760.022269:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166760.023000:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446787712:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166760.023011:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166760.023169:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.023208:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440013056 00000100:00100000:0.0:1762166760.023213:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440013056 00010000:00010000:0.0:1762166760.023230:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166760.023255:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 608 00000100:00100000:0.0:1762166760.023262:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:2419:x1847765440013056:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166760.023270:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.023275:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.023287:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.023299:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ac00/0x2f180c4effb0b119 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7734 expref: 17 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.023316:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:0.0:1762166760.023320:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.023327:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.023332:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.023353:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.023371:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166760.023381:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:2419:x1847765440013056:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 118us (211us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166760.023388:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166760.023394:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 608 00000100:00100000:1.0:1762166760.023625:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446787840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.023658:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166760.023685:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166760.023728:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446787840 00000100:00100000:3.0:1762166760.023734:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446787840 00000100:00100000:3.0:1762166760.023768:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1762166760.023776:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446787840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166760.023854:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446787840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166760.023862:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1762166760.023888:0:6498:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869335 gen 2 00000004:00080000:1.0:1762166760.023901:0:6498:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869335 committed transno 17179869335 00000100:00100000:1.0:1762166760.023924:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446787840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.023971:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446787968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.023993:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166760.024010:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166760.024032:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446787968 00000100:00100000:3.0:1762166760.024037:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446787968 00000100:00100000:3.0:1762166760.024065:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1762166760.024072:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446787968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166760.024131:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446787968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166760.024138:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1762166760.024159:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446787968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.024189:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446788096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.024207:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166760.024225:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166760.024244:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446788096 00000100:00100000:3.0:1762166760.024249:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446788096 00000100:00100000:3.0:1762166760.024273:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1762166760.024279:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446788096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166760.024328:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446788096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 50us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166760.024335:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1762166760.024356:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446788096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166760.024434:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967392 00000100:00100000:1.0:1762166760.024468:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446788224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.024520:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166760.024539:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166760.024561:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446788224 00000100:00100000:3.0:1762166760.024565:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446788224 00000100:00100000:3.0:1762166760.024591:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1762166760.024595:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446788224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166760.024691:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446788224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (170us total) trans 17179869340 rc 0/0 00000100:00100000:3.0:1762166760.024699:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1762166760.024719:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446788224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166760.024757:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967393 00010000:00010000:1.0:1762166760.024774:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024787:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024793:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024799:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.024803:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024810:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024818:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166760.024821:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166760.024825:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024830:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b143 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x8:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024840:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024845:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024850:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024854:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.024856:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024871:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024878:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.024880:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166760.024883:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024888:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b13c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.024898:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.024900:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166760.024904:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b0b7 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b771f expref: 18 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166760.024985:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440012800:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4174us (4253us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1762166760.024992:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 727 00000020:00080000:1.0:1762166760.024995:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166760.026098:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.026150:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440013184 00000100:00100000:1.0:1762166760.026157:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440013184 00000100:00100000:1.0:1762166760.026196:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2549 00000100:00100000:1.0:1762166760.026204:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+17:38407:x1847765440013184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.026216:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.026229:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7749 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.026264:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 18 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.026282:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 18 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.026296:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.026298:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166760.026301:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2b400, rc 0) 00000100:00100000:1.0:1762166760.026335:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:38407:x1847765440013184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 132us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.026341:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2549 00000100:00100000:2.0:1762166760.027622:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.027656:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440013440 00000100:00100000:1.0:1762166760.027662:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440013440 00000100:00100000:1.0:1762166760.027687:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 728 00000100:00100000:1.0:1762166760.027694:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+18:38407:x1847765440013440:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166760.027805:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:38407:x1847765440013440:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 111us (182us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1762166760.027813:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 728 00000100:00100000:2.0:1762166760.028715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.028749:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440013696 00000100:00100000:1.0:1762166760.028754:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440013696 00000100:00100000:1.0:1762166760.028779:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 729 00000100:00100000:1.0:1762166760.028784:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+19:38407:x1847765440013696:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166760.028857:0:6498:0:(mdd_object.c:3965:mdd_close()) Object [0x240000403:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166760.028894:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166760.028901:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.028915:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.028919:0:6498:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.028923:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.028926:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.028952:0:6498:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166760.028980:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166760.028988:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.028996:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2b000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166760.029001:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.029009:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.029021:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:2.0:1762166760.029024:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166760.029028:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.029041:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b151 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT1 00000100:00100000:1.0:1762166760.029052:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:38407:x1847765440013696:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 266us (336us total) trans 4294967396 rc 0/0 00010000:00010000:2.0:1762166760.029054:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166760.029058:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 729 00010000:00010000:2.0:1762166760.029059:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166760.029063:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166760.039588:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.039667:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440013824 00000100:00100000:1.0:1762166760.039677:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440013824 00000100:00100000:1.0:1762166760.039723:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2550 00000100:00100000:1.0:1762166760.039731:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+20:38409:x1847765440013824:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:1.0:1762166760.039768:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.039789:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b158 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7750 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.039853:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.039865:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.039873:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.039890:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.039895:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.039898:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.039978:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.039986:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.039991:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166760.040034:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00000004:00200000:1.0:1762166760.040038:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166760.040073:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040082:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040088:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040092:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040097:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040107:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.040111:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040116:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040124:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:1.0:1762166760.040127:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166760.040130:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040133:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b15f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040141:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040144:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040147:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040150:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2bc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.040152:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040155:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040158:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x3d8b1ba3 (ffff945cd0738d00) 00010000:00010000:1.0:1762166760.040159:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166760.040164:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040167:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b166 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.040190:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b158 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 22 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.040198:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.040203:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.040204:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166760.040206:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2aa00, rc 0) 00000100:00100000:1.0:1762166760.040257:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:38409:x1847765440013824:12345-192.168.204.38@tcp:101:stat.0 Request processed in 528us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.040262:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2550 00000100:00100000:3.0:1762166760.046883:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.046926:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440014080 00000100:00100000:1.0:1762166760.046945:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440014080 00000100:00100000:1.0:1762166760.046998:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2551 00000100:00100000:1.0:1762166760.047010:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+21:38410:x1847765440014080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.047030:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.047047:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b174 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7757 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.047142:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b17b lrc: 3/1,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.047155:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b17b lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.047187:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b17b lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166760.047199:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00010000:00010000:1.0:1762166760.047292:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b174 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7757 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.047307:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b17b lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7757 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.047314:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.047317:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166760.047320:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2a200, rc 0) 00000100:00100000:1.0:1762166760.047373:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:38410:x1847765440014080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 366us (497us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1762166760.047380:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2551 00000100:00100000:2.0:1762166760.049363:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.049400:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440014336 00000100:00100000:1.0:1762166760.049406:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440014336 00000100:00100000:1.0:1762166760.049435:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2552 00000100:00100000:1.0:1762166760.049440:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+23:38410:x1847765440014336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.049452:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.049461:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b189 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b775e expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.049528:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.049538:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.049549:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.049572:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.049590:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 24 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166760.049600:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446788352:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166760.049658:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166760.050426:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446788352:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166760.050446:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166760.050646:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.050699:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440014464 00000100:00100000:0.0:1762166760.050711:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440014464 00010000:00010000:0.0:1762166760.050733:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 25 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166760.050777:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 609 00000100:00100000:0.0:1762166760.050787:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2419:x1847765440014464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166760.050798:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.050811:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 25 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.050823:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 25 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.050856:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b16d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7750 expref: 25 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.050874:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:0.0:1762166760.050879:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.050891:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.050898:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.050924:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.050952:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.050961:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166760.050972:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00000100:00100000:0.0:1762166760.050974:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:2419:x1847765440014464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 189us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.050984:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 609 00010000:00010000:1.0:1762166760.051067:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b189 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b775e expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.051081:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b775e expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.051088:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.051097:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166760.051100:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2bc00, rc 0) 00000100:00100000:1.0:1762166760.051135:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38410:x1847765440014336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1694us (1773us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1762166760.051142:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2552 00000100:00100000:2.0:1762166760.052162:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.052203:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440014592 00000100:00100000:1.0:1762166760.052208:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440014592 00000100:00100000:1.0:1762166760.052244:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 730 00000100:00100000:1.0:1762166760.052253:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38410:x1847765440014592:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:1.0:1762166760.052342:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38410:x1847765440014592:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 91us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.052350:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 730 00000100:00100000:3.0:1762166760.053012:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.053049:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440014848 00000100:00100000:1.0:1762166760.053054:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440014848 00000100:00100000:1.0:1762166760.053086:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 731 00000100:00100000:1.0:1762166760.053091:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38410:x1847765440014848:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166760.053182:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:38410:x1847765440014848:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 90us (171us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1762166760.053187:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 731 00000100:00100000:3.0:1762166760.053986:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.054015:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440015104 00000100:00100000:1.0:1762166760.054019:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440015104 00000100:00100000:1.0:1762166760.054043:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2553 00000100:00100000:1.0:1762166760.054048:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:38410:x1847765440015104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.054056:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.054059:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166760.054072:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b190 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b775e expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.054092:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b17b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7757 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.054098:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.054100:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.054107:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b19e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7765 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.054145:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1a5 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.054152:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1a5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.054157:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1a5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166760.054163:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00010000:00010000:1.0:1762166760.054196:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b19e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7765 expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.054203:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1a5 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7765 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.054208:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.054209:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166760.054211:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2ba00, rc 0) 00000100:00100000:1.0:1762166760.054234:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:38410:x1847765440015104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 187us (250us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1762166760.054245:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2553 00000100:00100000:2.0:1762166760.055088:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.055126:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440015360 00000100:00100000:1.0:1762166760.055131:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440015360 00000100:00100000:1.0:1762166760.055158:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 732 00000100:00100000:1.0:1762166760.055167:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:38410:x1847765440015360:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166760.055195:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000403:0x6:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1a5 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7765 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.055210:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166760.055218:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.055225:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.055249:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.055260:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 25 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166760.055269:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446788480:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166760.055311:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166760.056060:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446788480:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166760.056076:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166760.056362:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.056406:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440015488 00000100:00100000:0.0:1762166760.056412:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440015488 00010000:00010000:0.0:1762166760.056431:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 26 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166760.056454:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 610 00000100:00100000:0.0:1762166760.056462:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+26:2418:x1847765440015488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166760.056470:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.056474:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 26 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.056511:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 26 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.056521:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b400/0x2f180c4effb0b14a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7749 expref: 26 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.056529:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:0.0:1762166760.056532:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.056537:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.056541:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.056556:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.056586:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166760.056587:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:2418:x1847765440015488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 124us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.056601:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 610 00010000:00010000:1.0:1762166760.056608:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.056740:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.056754:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.056761:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.056767:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.056771:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.056778:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.056787:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.056790:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166760.056794:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.056799:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b1b3 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.056808:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.056811:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166760.056815:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1a5 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7765 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166760.056905:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38410:x1847765440015360:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1739us (1816us total) trans 4294967401 rc -22/-22 00000100:00100000:1.0:1762166760.056912:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 732 00000100:00100000:2.0:1762166760.061874:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.061915:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440015616 00000100:00100000:1.0:1762166760.061922:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440015616 00000100:00100000:1.0:1762166760.061964:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2554 00000100:00100000:1.0:1762166760.061971:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+24:38410:x1847765440015616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.061986:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.061996:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b776c expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.062029:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.062050:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.062065:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.062069:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166760.062071:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2aa00, rc 0) 00000100:00100000:1.0:1762166760.062110:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:38410:x1847765440015616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 140us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.062115:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2554 00000100:00100000:3.0:1762166760.063904:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.063942:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440015872 00000100:00100000:1.0:1762166760.063946:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440015872 00000100:00100000:1.0:1762166760.063970:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2555 00000100:00100000:1.0:1762166760.063985:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+25:38410:x1847765440015872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.063994:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.064002:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b1c1 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7773 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.064366:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.064373:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.064379:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166760.064386:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 0 00010000:00010000:1.0:1762166760.064416:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b1c1 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 28 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.064426:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.064430:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:1.0:1762166760.064432:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166760.064434:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2a200, rc 0) 00000100:00100000:1.0:1762166760.064461:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+27:38410:x1847765440015872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 477us (558us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1762166760.064465:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2555 00000100:00100000:3.0:1762166760.065642:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.065677:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440016128 00000100:00100000:1.0:1762166760.065682:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440016128 00000100:00100000:1.0:1762166760.065712:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2556 00000100:00100000:1.0:1762166760.065726:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+27:38410:x1847765440016128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.065740:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.065749:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b1d6 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b777a expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.065796:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b1dd lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.065804:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b1dd lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.065812:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b1dd lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166760.065820:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00010000:00010000:1.0:1762166760.065868:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b1d6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b777a expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.065880:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b1dd lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b777a expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.065887:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.065890:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166760.065893:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2a400, rc 0) 00000100:00100000:1.0:1762166760.065923:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:38410:x1847765440016128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 198us (283us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1762166760.065929:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2556 00000100:00100000:2.0:1762166760.067382:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.067417:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440016384 00000100:00100000:1.0:1762166760.067421:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440016384 00000100:00100000:1.0:1762166760.067448:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 733 00000100:00100000:1.0:1762166760.067460:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:38410:x1847765440016384:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166760.067558:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000403:0x6:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b1dd lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b777a expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.067581:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166760.067591:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.067599:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.067622:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 29 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.067632:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 29 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166760.067641:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446788608:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166760.067692:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166760.068597:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446788608:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166760.068615:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166760.068775:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.068816:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440016512 00000100:00100000:0.0:1762166760.068821:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440016512 00010000:00010000:0.0:1762166760.068839:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 30 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166760.068868:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 611 00000100:00100000:0.0:1762166760.068877:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:2418:x1847765440016512:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166760.068887:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.068900:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 30 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.068911:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 30 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.068924:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2aa00/0x2f180c4effb0b1ba lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b776c expref: 30 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.068945:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:0.0:1762166760.068950:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.068957:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.068963:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.068982:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.069003:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.069012:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166760.069015:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:2418:x1847765440016512:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.069028:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 611 00010000:00010000:1.0:1762166760.069058:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166760.069069:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 28 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.069075:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.069091:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 28 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.069099:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 28 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:1.0:1762166760.069107:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446788736:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166760.069139:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166760.069833:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446788736:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166760.069842:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166760.069971:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.070018:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440016640 00000100:00100000:0.0:1762166760.070023:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440016640 00010000:00010000:0.0:1762166760.070042:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 29 pid: 12357 timeout: 479 lvb_type: 0 00000100:00100000:0.0:1762166760.070072:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 612 00000100:00100000:0.0:1762166760.070079:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:2418:x1847765440016640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166760.070088:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.070099:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 29 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.070106:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 29 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.070114:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a200/0x2f180c4effb0b1c8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7773 expref: 29 pid: 12357 timeout: 479 lvb_type: 0 00010000:00010000:0.0:1762166760.070123:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:0.0:1762166760.070126:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.070133:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.070138:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166760.070156:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166760.070170:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070175:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166760.070183:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+28:2418:x1847765440016640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 103us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.070192:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 612 00000100:00100000:1.0:1762166760.070369:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446788864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.070396:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166760.070419:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166760.070431:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446788864 00000100:00100000:3.0:1762166760.070435:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446788864 00000100:00100000:3.0:1762166760.070461:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1762166760.070467:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446788864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166760.070555:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446788864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166760.070561:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1762166760.070588:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446788864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.070625:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446788992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166760.070647:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166760.070664:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166760.070666:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446788992 00000100:00100000:3.0:1762166760.070670:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446788992 00000100:00100000:3.0:1762166760.070688:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1762166760.070692:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446788992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166760.070730:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446788992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 38us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166760.070735:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1762166760.070753:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446788992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1762166760.070777:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1762166760.070805:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967405 00010000:00010000:1.0:1762166760.070815:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070820:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070825:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070829:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.070832:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070836:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070842:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:1.0:1762166760.070844:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166760.070847:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070850:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b1f2 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070869:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070872:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070876:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070878:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.070880:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070883:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070887:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.070888:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166760.070889:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070892:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b1eb lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.070898:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.070899:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166760.070902:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b1dd lrc: 0/0,0 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b777a expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166760.070960:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:38410:x1847765440016384:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3501us (3579us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1762166760.070965:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 733 00000020:00080000:1.0:1762166760.070972:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166760.071648:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.071677:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440016768 00000100:00100000:1.0:1762166760.071681:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440016768 00000100:00100000:1.0:1762166760.071714:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2557 00000100:00100000:1.0:1762166760.071723:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+29:38410:x1847765440016768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166760.071735:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.071745:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b1f9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7781 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.071775:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b1f9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7781 expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.071782:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b1f9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7781 expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.071792:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.071794:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166760.071796:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2b800, rc 0) 00000100:00100000:1.0:1762166760.071819:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:38410:x1847765440016768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 99us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.071823:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2557 00000100:00100000:2.0:1762166760.072811:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.072837:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440017024 00000100:00100000:1.0:1762166760.072841:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440017024 00000100:00100000:1.0:1762166760.072862:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 734 00000100:00100000:1.0:1762166760.072867:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+30:38410:x1847765440017024:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166760.073027:0:6498:0:(mdd_object.c:3965:mdd_close()) Object [0x240000403:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166760.073084:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].10, 64 off8976 00000004:00080000:1.0:1762166760.073092:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 379221614334ns, next at 380221612672ns, rc = 0 00000001:00080000:1.0:1762166760.073102:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1762166760.073122:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166760.073128:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.073133:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.073140:0:6498:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.073145:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.073150:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166760.073168:0:6498:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166760.073214:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166760.073221:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.073228:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2a800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166760.073231:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.073238:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.073248:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff945cd0738b00) 00010000:00010000:2.0:1762166760.073251:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166760.073254:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.073266:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a800/0x2f180c4effb0b200 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166760.073279:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166760.073281:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166760.073284:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166760.073288:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+32:38410:x1847765440017024:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 417us (474us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1762166760.073296:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 734 00000020:00080000:1.0:1762166760.073300:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166760.073843:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.073876:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440017280 00000100:00100000:1.0:1762166760.073881:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440017280 00000100:00100000:1.0:1762166760.073904:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 735 00000100:00100000:1.0:1762166760.073909:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+32:38410:x1847765440017280:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166760.074017:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+33:38410:x1847765440017280:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 107us (174us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1762166760.074022:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 735 00000100:00100000:3.0:1762166760.080119:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.080162:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440017408 00000100:00100000:1.0:1762166760.080182:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440017408 00000100:00100000:1.0:1762166760.080236:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2558 00000100:00100000:1.0:1762166760.080246:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+33:38411:x1847765440017408:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:1.0:1762166760.080268:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.080285:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b207 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7788 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.080341:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 3/1,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.080355:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080366:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080379:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.080385:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080389:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080452:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b21c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166760.080460:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b21c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080466:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b21c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166760.080533:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00000004:00200000:1.0:1762166760.080537:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166760.080554:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b21c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080565:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b21c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080573:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080578:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080584:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080590:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.080594:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080601:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080611:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:1.0:1762166760.080614:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166760.080618:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080623:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b000/0x2f180c4effb0b20e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080634:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080646:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080652:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080658:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166760.080661:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080666:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080673:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x3d8b1ba3 (ffff945cd0738d00) 00010000:00010000:1.0:1762166760.080676:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166760.080678:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080684:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b215 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.080711:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2a400/0x2f180c4effb0b207 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7788 expref: 35 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.080723:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b21c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7788 expref: 34 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.080730:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:1.0:1762166760.080732:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166760.080734:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2bc00, rc 0) 00000100:00100000:1.0:1762166760.080788:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+34:38411:x1847765440017408:12345-192.168.204.38@tcp:101:stat.0 Request processed in 542us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.080801:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2558 00000100:00100000:2.0:1762166760.082116:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.082161:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440017536 00000100:00100000:0.0:1762166760.082166:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440017536 00000100:00100000:0.0:1762166760.082195:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 925 00000100:00100000:0.0:1762166760.082200:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765440017536:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:0.0:1762166760.082209:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166760.082218:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b223 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b778f expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166760.082266:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446789120:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166760.082319:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166760.083036:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446789120:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166760.083052:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b223 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b778f expref: 10 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166760.083081:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b223 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b778f expref: 10 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166760.083090:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2e00, rc 0) 00000100:00100000:0.0:1762166760.083122:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2418:x1847765440017536:12345-192.168.204.38@tcp:101:stat.0 Request processed in 921us (1007us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166760.083129:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 925 00000100:00100000:1.0:1762166760.210644:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1762166760.210648:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166760.210664:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446789248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166760.210738:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166760.210784:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446789248 00000100:00100000:3.0:1762166760.210792:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446789248 00000100:00100000:3.0:1762166760.210831:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1762166760.210837:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765446789248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1762166760.210869:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446031360 avail 1299791872 00000100:00100000:3.0:1762166760.210910:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765446789248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166760.210916:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1762166760.210990:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446789248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166760.342110:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.342181:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440017792 00000100:00100000:1.0:1762166760.342192:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440017792 00000100:00100000:1.0:1762166760.342250:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 736 00000100:00100000:1.0:1762166760.342262:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+34:38429:x1847765440017792:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:1.0:1762166760.342545:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+35:38429:x1847765440017792:12345-192.168.204.38@tcp:35:umount.0 Request processed in 285us (444us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1762166760.342554:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 736 00000100:00100000:2.0:1762166760.343519:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.343577:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440018048 00000100:00100000:1.0:1762166760.343582:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440018048 00000100:00100000:1.0:1762166760.343617:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 737 00000100:00100000:1.0:1762166760.343627:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:38429:x1847765440018048:12345-192.168.204.38@tcp:35:umount.0 00000100:00100000:1.0:1762166760.343748:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:38429:x1847765440018048:12345-192.168.204.38@tcp:35:umount.0 Request processed in 123us (229us total) trans 4294968852 rc 0/0 00000100:00100000:1.0:1762166760.343756:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 737 00000100:00100000:3.0:1762166760.345303:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.345350:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440018176 00000100:00100000:0.0:1762166760.345361:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440018176 00000100:00100000:3.0:1762166760.345378:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.345409:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440018304 00000100:00100000:0.0:1762166760.345414:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440018304 00000100:00100000:2.0:1762166760.345434:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 273 00000100:00100000:2.0:1762166760.345447:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ccec70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:332e157a-5c6a-4389-857f-15641f8aa9a8+10:2418:x1847765440018176:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166760.345448:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 274 00000100:00100000:0.0:1762166760.345460:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:332e157a-5c6a-4389-857f-15641f8aa9a8+10:2418:x1847765440018304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166760.345465:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.345469:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166760.345505:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cf3cb5600/0x2f180c4effb09408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b6f62 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.345510:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bc7f41c00/0x2f180c4effb09401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b6f31 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.345520:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166760.345525:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166760.345538:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.345558:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ccec70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:332e157a-5c6a-4389-857f-15641f8aa9a8+8:2418:x1847765440018176:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.345564:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:332e157a-5c6a-4389-857f-15641f8aa9a8+8:2418:x1847765440018304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 105us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.345572:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 273 00000100:00100000:3.0:1762166760.345578:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440018432 00000100:00100000:0.0:1762166760.345579:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 274 00000100:00100000:3.0:1762166760.345585:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440018432 00000100:00100000:2.0:1762166760.345630:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 275 00000100:00100000:2.0:1762166760.345639:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:332e157a-5c6a-4389-857f-15641f8aa9a8+7:2419:x1847765440018432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166760.345646:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166760.345655:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cf3cb4c00/0x2f180c4effb0940f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b6f69 expref: 7 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.345665:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166760.345686:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:332e157a-5c6a-4389-857f-15641f8aa9a8+6:2419:x1847765440018432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 48us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.345703:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 275 00000100:00100000:0.0:1762166760.354007:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.354061:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440018944 00000100:00100000:2.0:1762166760.354071:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440018944 00000100:00100000:2.0:1762166760.354119:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 926 00000100:00100000:2.0:1762166760.354128:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2415:x1847765440018944:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:2.0:1762166760.354155:0:9168:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0942b 00000020:00010000:2.0:1762166760.354160:0:9168:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945bc4382800: total 0 00000100:00080000:2.0:1762166760.354164:0:9168:0:(import.c:65:import_set_state_nolock()) ffff945cf4176000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1762166760.354193:0:7420:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945bc4382800: total 0 00010000:00010000:0.0:1762166760.354197:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1762166760.354213:0:9168:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869340 00010000:00010000:0.0:1762166760.354235:0:7420:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945bc4382800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1762166760.354279:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b120 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b773b expref: 8 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.354307:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3c9f200/0x2f180c4effb0ad29 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7615 expref: 8 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166760.354323:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b02b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b76ee expref: 5 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.354333:0:7420:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945bc4382800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1762166760.354341:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166760.354343:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166760.354344:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166760.354369:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+3:2415:x1847765440018944:12345-192.168.204.38@tcp:9:umount.0 Request processed in 240us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.354377:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 926 00000100:00100000:3.0:1762166760.360784:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.360856:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440019328 00000100:00100000:2.0:1762166760.360865:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440019328 00000100:00100000:2.0:1762166760.360913:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 927 00000100:00100000:2.0:1762166760.360938:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+9:2415:x1847765440019328:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:2.0:1762166760.360967:0:9168:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb09424 00000020:00010000:2.0:1762166760.360974:0:9168:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945cf798d800: total 0 00000100:00080000:2.0:1762166760.360978:0:9168:0:(import.c:65:import_set_state_nolock()) ffff945cf798a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1762166760.361020:0:9168:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836654 00000020:00010000:0.0:1762166760.361020:0:10257:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945cf798d800: total 0 00010000:00010000:0.0:1762166760.361068:0:10257:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945cf798d800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1762166760.361115:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3c9fa00/0x2f180c4effb0ad45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b761c expref: 9 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.361146:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b135 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7742 expref: 6 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166760.361174:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+5:2415:x1847765440019328:12345-192.168.204.38@tcp:9:umount.0 Request processed in 246us (396us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166760.361181:0:10257:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945cf798d800, canceled 2 locks, left on hash table 0. 00000100:00100000:2.0:1762166760.361185:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 927 00010000:00010000:0.0:1762166760.361204:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166760.361208:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166760.361211:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166760.364721:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.364779:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440020480 00000100:00100000:2.0:1762166760.364787:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440020480 00000100:00100000:2.0:1762166760.364835:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2559 00000100:00100000:2.0:1762166760.364844:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+16:2415:x1847765440020480:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:2.0:1762166760.364876:0:12357:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb09416 00000020:00010000:2.0:1762166760.364883:0:12357:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945bc4384000: total 0 00000100:00080000:2.0:1762166760.364885:0:12357:0:(import.c:65:import_set_state_nolock()) ffff945bc4384800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1762166760.364904:0:12357:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968852 00000020:00010000:1.0:1762166760.364918:0:10256:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945bc4384000: total 0 00010000:00010000:1.0:1762166760.364989:0:10256:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945bc4384000, canceled 0 locks, left on hash table 10. 00010000:00010000:1.0:1762166760.365021:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945bc403af00) 00010000:00010000:1.0:1762166760.365030:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166760.365038:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb0a503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73bb expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166760.365046:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+15:2415:x1847765440020480:12345-192.168.204.38@tcp:39:umount.0 Request processed in 200us (327us total) trans 4294968853 rc 0/0 00000100:00100000:2.0:1762166760.365058:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2559 00010000:00010000:1.0:1762166760.365073:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166760.365078:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166760.365083:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0aee2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7677 expref: 13 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365100:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166760.365103:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1762166760.365107:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0aa74 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x11:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b754a expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365122:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xe:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166760.365125:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1762166760.365130:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3dc6600/0x2f180c4effb0a80c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b749b expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365148:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:1.0:1762166760.365151:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166760.365155:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0addf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7646 expref: 10 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365167:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f700) 00010000:00010000:1.0:1762166760.365170:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166760.365174:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0a4d9 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73a6 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365188:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff945cc9b89c00) 00010000:00010000:1.0:1762166760.365196:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166760.365201:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0ac57 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x11:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b75e4 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365220:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff945cd0738a00) 00010000:00010000:1.0:1762166760.365223:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166760.365226:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3c9ee00/0x2f180c4effb0ae4f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7662 expref: 7 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365241:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc403a500) 00010000:00010000:1.0:1762166760.365244:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166760.365248:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0aefe lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b767e expref: 6 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365262:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945bc477f500) 00010000:00010000:1.0:1762166760.365266:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166760.365270:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0a860 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74b0 expref: 5 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.365283:0:10256:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945bc4384000, canceled 10 locks, left on hash table 0. 00010000:00010000:1.0:1762166760.365298:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166760.365300:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166760.365301:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166760.369615:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.369671:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440021120 00000100:00100000:2.0:1762166760.369678:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440021120 00000100:00100000:2.0:1762166760.369710:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2560 00000100:00100000:2.0:1762166760.369716:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+35:2415:x1847765440021120:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:2.0:1762166760.369739:0:12357:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0941d 00000020:00010000:2.0:1762166760.369747:0:12357:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945cc7d3c800: total 0 00000100:00080000:2.0:1762166760.369751:0:12357:0:(import.c:65:import_set_state_nolock()) ffff945bc2d54800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1762166760.369792:0:12357:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967410 00000020:00010000:3.0:1762166760.369799:0:6482:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945cc7d3c800: total 0 00010000:00010000:1.0:1762166760.369813:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.369813:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.369824:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.369824:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.369832:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.369832:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.369839:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166760.369844:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166760.369846:0:6482:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945cc7d3c800, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1762166760.369854:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166760.369855:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.369857:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.369863:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.369868:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:0.0:1762166760.369871:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166760.369874:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166760.369880:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b200/0x2f180c4effb0b112 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166760.369886:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:3.0:1762166760.369891:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166760.369895:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:3.0:1762166760.369898:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2bc00/0x2f180c4effb0b21c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7788 expref: 34 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166760.369899:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166760.369906:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166760.369915:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b12e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166760.369922:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f400) 00010000:00010000:3.0:1762166760.369937:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1762166760.369941:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0a4e7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73ad expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166760.369951:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5f20b66-016a-4159-9d62-071c0da3ef0b+31:2415:x1847765440021120:12345-192.168.204.38@tcp:39:umount.0 Request processed in 232us (337us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1762166760.369967:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2560 00010000:00010000:3.0:1762166760.369971:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f400) 00010000:00010000:3.0:1762166760.369975:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166760.369979:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0a526 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b73c9 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166760.369990:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945bc580a700) 00010000:00010000:3.0:1762166760.369992:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1762166760.369994:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0af0c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7685 expref: 28 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166760.370007:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3b00) 00010000:00010000:3.0:1762166760.370009:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166760.370012:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa2b800/0x2f180c4effb0b1f9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7781 expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166760.370023:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4:0x0].0x0 (ffff945cd1ddda00) 00010000:00010000:3.0:1762166760.370024:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1762166760.370026:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0a86e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x4:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b74b7 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166760.370035:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff945bc477f400) 00010000:00010000:3.0:1762166760.370036:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166760.370039:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0a60d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7416 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166760.370047:0:6482:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945cc7d3c800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1762166760.370056:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166760.370057:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166760.370062:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166760.379363:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.379433:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440021376 00000100:00100000:0.0:1762166760.379443:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440021376 00000100:00100000:0.0:1762166760.379525:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 560 00000100:00100000:0.0:1762166760.379547:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cce8da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:332e157a-5c6a-4389-857f-15641f8aa9a8+6:2415:x1847765440021376:12345-192.168.204.38@tcp:251:umount.0 00000020:00000080:0.0:1762166760.379577:0:6489:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb093f3 00000020:00010000:0.0:1762166760.379582:0:6489:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945bc4381800: total 0 00000100:00080000:0.0:1762166760.379586:0:6489:0:(import.c:65:import_set_state_nolock()) ffff945bc4383800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1762166760.379644:0:6483:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945bc4381800: total 0 00000100:00100000:0.0:1762166760.379647:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cce8da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:332e157a-5c6a-4389-857f-15641f8aa9a8+3:2415:x1847765440021376:12345-192.168.204.38@tcp:251:umount.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.379655:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 560 00010000:00010000:2.0:1762166760.379700:0:6483:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945bc4381800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1762166760.379733:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bc7f40e00/0x2f180c4effb093fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b6f2a expref: 2 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.379758:0:6483:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945bc4381800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1762166760.379769:0:6483:0:(genops.c:904:class_export_put()) final put ffff945bc4381800/332e157a-5c6a-4389-857f-15641f8aa9a8 00010000:00010000:2.0:1762166760.379789:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166760.379792:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166760.379800:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1762166760.379816:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc4381800/332e157a-5c6a-4389-857f-15641f8aa9a8 for MGS 00000020:00000080:1.0:1762166760.379853:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc4383800 for MGS 00000100:00100000:0.0:1762166760.450582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166760.450646:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440021504 00000100:00100000:3.0:1762166760.450656:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440021504 00000100:00100000:3.0:1762166760.450696:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 561 00000100:00100000:3.0:1762166760.450706:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc9c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2415:x1847765440021504:12345-192.168.204.38@tcp:250:mount.lustre.0 00010000:00080000:3.0:1762166760.450732:0:6489:0:(ldlm_lib.c:1428:target_handle_connect()) MGS: connection from 918fd9a9-e029-468d-bf95-286cac877d5e@192.168.204.38@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:3.0:1762166760.450761:0:6489:0:(genops.c:1402:class_connect()) connect: client 918fd9a9-e029-468d-bf95-286cac877d5e, cookie 0x2f180c4effb0b22a 00000020:01000000:3.0:1762166760.450770:0:6489:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc7b09c00 00000100:00080000:3.0:1762166760.450802:0:6489:0:(import.c:65:import_set_state_nolock()) ffff945bc4b77000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166760.450870:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc9c5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+4:2415:x1847765440021504:12345-192.168.204.38@tcp:250:mount.lustre.0 Request processed in 164us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166760.450878:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 561 00000100:00100000:3.0:1762166760.451852:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.451893:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440021632 00000100:00100000:0.0:1762166760.451898:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440021632 00000100:00100000:0.0:1762166760.451935:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 562 00000100:00100000:0.0:1762166760.451944:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc9c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+4:38442:x1847765440021632:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762166760.451955:0:6489:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166760.451971:0:6489:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e3000/0x2f180c4effb0b231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b77a4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.451991:0:6489:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e3000/0x2f180c4effb0b231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77a4 expref: 5 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.452004:0:6489:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e3000/0x2f180c4effb0b231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77a4 expref: 5 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.452015:0:6489:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3000, rc 0) 00000100:00100000:0.0:1762166760.452044:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc9c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+5:38442:x1847765440021632:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 104us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.452049:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 562 00000100:00100000:2.0:1762166760.452885:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.452936:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440021760 00000100:00100000:0.0:1762166760.452940:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440021760 00000100:00100000:0.0:1762166760.452973:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 563 00000100:00100000:0.0:1762166760.452978:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc9c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+5:38442:x1847765440021760:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1762166760.453042:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc9c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+5:38442:x1847765440021760:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 64us (159us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166760.453048:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 563 00000100:00100000:1.0:1762166760.453773:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.453807:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440021888 00000100:00100000:0.0:1762166760.453811:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440021888 00000100:00100000:0.0:1762166760.453837:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 564 00000100:00100000:0.0:1762166760.453842:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc9c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+5:38442:x1847765440021888:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762166760.453848:0:6489:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166760.453855:0:6489:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e2800/0x2f180c4effb0b238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b77ab expref: -99 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.453866:0:6489:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e2800/0x2f180c4effb0b238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77ab expref: 6 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.453872:0:6489:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e2800/0x2f180c4effb0b238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77ab expref: 6 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.453877:0:6489:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2800, rc 0) 00000100:00100000:0.0:1762166760.453899:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc9c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+6:38442:x1847765440021888:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.453903:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 564 00000100:00100000:3.0:1762166760.454638:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.454690:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440022016 00000100:00100000:0.0:1762166760.454695:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440022016 00000100:00100000:0.0:1762166760.454724:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 565 00000100:00100000:0.0:1762166760.454733:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+6:38442:x1847765440022016:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1762166760.454843:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38442:x1847765440022016:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 111us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.454850:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 565 00000100:00100000:2.0:1762166760.455529:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.455572:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440022144 00000100:00100000:0.0:1762166760.455577:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440022144 00000100:00100000:0.0:1762166760.455603:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 566 00000100:00100000:0.0:1762166760.455611:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38442:x1847765440022144:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1762166760.455686:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38442:x1847765440022144:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.455694:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 566 00000100:00100000:1.0:1762166760.456642:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.456684:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440022272 00000100:00100000:0.0:1762166760.456689:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440022272 00000100:00100000:0.0:1762166760.456716:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 567 00000100:00100000:0.0:1762166760.456723:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38461:x1847765440022272:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166760.456793:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38461:x1847765440022272:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.456800:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 567 00000100:00100000:3.0:1762166760.467172:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.467233:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440022400 00000100:00100000:0.0:1762166760.467245:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440022400 00000100:00100000:0.0:1762166760.467301:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 568 00000100:00100000:0.0:1762166760.467313:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38461:x1847765440022400:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166760.467466:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38461:x1847765440022400:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 155us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.467475:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 568 00000100:00100000:2.0:1762166760.468808:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.468869:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440022528 00000100:00100000:0.0:1762166760.468877:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440022528 00000100:00100000:0.0:1762166760.468918:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 569 00000100:00100000:0.0:1762166760.468940:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38461:x1847765440022528:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166760.469032:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38461:x1847765440022528:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 106us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.469040:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 569 00000100:00100000:1.0:1762166760.470317:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.470369:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440022656 00000100:00100000:0.0:1762166760.470378:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440022656 00000100:00100000:0.0:1762166760.470406:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 570 00000100:00100000:0.0:1762166760.470412:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+7:38442:x1847765440022656:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762166760.470421:0:6489:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166760.470434:0:6489:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e2e00/0x2f180c4effb0b23f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b77dc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.470454:0:6489:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e2e00/0x2f180c4effb0b23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77dc expref: 8 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.470461:0:6489:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e2e00/0x2f180c4effb0b23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77dc expref: 8 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.470467:0:6489:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2e00, rc 0) 00000100:00100000:0.0:1762166760.470514:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+8:38442:x1847765440022656:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 102us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.470518:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 570 00000100:00100000:3.0:1762166760.471801:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.471843:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440022784 00000100:00100000:0.0:1762166760.471848:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440022784 00000100:00100000:0.0:1762166760.471877:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 571 00000100:00100000:0.0:1762166760.471896:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+8:38442:x1847765440022784:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1762166760.471912:0:6489:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1762166760.471937:0:6489:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1762166760.471941:0:6489:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1762166760.471943:0:6489:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1762166760.471945:0:6489:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1762166760.471947:0:6489:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 13 00000100:00100000:0.0:1762166760.472741:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+8:38442:x1847765440022784:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 848us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.472747:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 571 00000100:00100000:1.0:1762166760.474438:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.474498:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440022912 00000100:00100000:0.0:1762166760.474503:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440022912 00000100:00100000:0.0:1762166760.474530:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 572 00000100:00100000:0.0:1762166760.474535:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+8:38442:x1847765440022912:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762166760.474544:0:6489:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166760.474556:0:6489:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e2c00/0x2f180c4effb0b246 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b77e3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.474577:0:6489:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e2c00/0x2f180c4effb0b246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77e3 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.474587:0:6489:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e2c00/0x2f180c4effb0b246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77e3 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166760.474594:0:6489:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2c00, rc 0) 00000100:00100000:0.0:1762166760.474629:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38442:x1847765440022912:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 92us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.474635:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 572 00000100:00100000:3.0:1762166760.475378:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.475460:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440023040 00000100:00100000:0.0:1762166760.475469:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440023040 00000100:00100000:0.0:1762166760.475527:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 573 00000100:00100000:0.0:1762166760.475536:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38442:x1847765440023040:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1762166760.475687:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38442:x1847765440023040:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 152us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.475693:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 573 00000100:00100000:2.0:1762166760.476434:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.476492:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440023168 00000100:00100000:0.0:1762166760.476496:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440023168 00000100:00100000:0.0:1762166760.476526:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 574 00000100:00100000:0.0:1762166760.476533:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38442:x1847765440023168:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1762166760.476617:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38442:x1847765440023168:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.476624:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 574 00000100:00100000:1.0:1762166760.477574:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.477633:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440023296 00000100:00100000:0.0:1762166760.477640:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440023296 00000100:00100000:0.0:1762166760.477675:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 575 00000100:00100000:0.0:1762166760.477683:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38464:x1847765440023296:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166760.477775:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38464:x1847765440023296:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.477781:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 575 00000100:00100000:3.0:1762166760.478600:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.478642:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440023424 00000100:00100000:0.0:1762166760.478648:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440023424 00000100:00100000:0.0:1762166760.478679:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 576 00000100:00100000:0.0:1762166760.478686:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38464:x1847765440023424:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166760.478777:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:918fd9a9-e029-468d-bf95-286cac877d5e+9:38464:x1847765440023424:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 91us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.478785:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 576 00000100:00100000:2.0:1762166760.480246:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.480283:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.480305:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440023552 00000100:00100000:1.0:1762166760.480311:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440023552 00000100:00100000:0.0:1762166760.480339:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440023808 00000100:00100000:0.0:1762166760.480343:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440023808 00000100:00100000:1.0:1762166760.480347:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2561 00000100:00100000:1.0:1762166760.480353:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2415:x1847765440023552:12345-192.168.204.38@tcp:38:mount.lustre.0 00000100:00100000:0.0:1762166760.480370:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2562 00000100:00100000:0.0:1762166760.480376:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2415:x1847765440023808:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1762166760.480384:0:12357:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp t0 exp 0000000000000000 cur 379 last 0 00010000:00080000:0.0:1762166760.480391:0:6494:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0001: connection from fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:1.0:1762166760.480426:0:12357:0:(genops.c:1402:class_connect()) connect: client fd0f52a9-204e-4869-b8da-3af938f6f960, cookie 0x2f180c4effb0b254 00000020:00000080:0.0:1762166760.480426:0:6494:0:(genops.c:1402:class_connect()) connect: client fd0f52a9-204e-4869-b8da-3af938f6f960, cookie 0x2f180c4effb0b24d 00000004:00100000:1.0:1762166760.480453:0:12357:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:0.0:1762166760.480453:0:6494:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000020:01000000:1.0:1762166760.480541:0:12357:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc9c25900 00000020:01000000:0.0:1762166760.480541:0:6494:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf1f8fc00 00000100:00080000:1.0:1762166760.480581:0:12357:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1762166760.480581:0:6494:0:(import.c:65:import_set_state_nolock()) ffff945bcc02b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166760.480626:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:2415:x1847765440023552:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 271us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.480626:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f52a9-204e-4869-b8da-3af938f6f960+6:2415:x1847765440023808:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 249us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.480635:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2562 00000100:00100000:1.0:1762166760.480638:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2561 00000100:00100000:1.0:1762166760.481844:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.481867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.481884:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440023936 00000100:00100000:2.0:1762166760.481889:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440023936 00000100:00100000:0.0:1762166760.481907:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440023680 00000100:00100000:0.0:1762166760.481912:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440023680 00000100:00080000:1.0:1762166760.481949:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1762166760.481955:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166760.481967:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2563 00000100:00100000:0.0:1762166760.481977:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2564 00000100:00100000:2.0:1762166760.481985:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:0:x1847765440023936:12345-192.168.204.38@tcp:41:mount.lustre.0 00000100:00100000:0.0:1762166760.481991:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f52a9-204e-4869-b8da-3af938f6f960+6:0:x1847765440023680:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1762166760.482019:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446031360 avail 1299791872 00000004:00000024:2.0:1762166760.482021:0:12357:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446256640 avail 1300017152 00000100:00100000:0.0:1762166760.482077:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd0f52a9-204e-4869-b8da-3af938f6f960+6:0:x1847765440023680:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.482080:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:0:x1847765440023936:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.482088:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2564 00000100:00100000:2.0:1762166760.482096:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2563 00000100:00100000:3.0:1762166760.482137:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.482171:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440024064 00000100:00100000:2.0:1762166760.482177:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440024064 00000100:00100000:2.0:1762166760.482201:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2565 00000100:00100000:2.0:1762166760.482208:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38442:x1847765440024064:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1762166760.482220:0:12357:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446031360 avail 1299791872 00000100:00100000:2.0:1762166760.482250:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38442:x1847765440024064:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.482258:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2565 00000100:00100000:3.0:1762166760.482831:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.482879:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440024192 00000100:00100000:2.0:1762166760.482885:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440024192 00000100:00100000:2.0:1762166760.482915:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2566 00000100:00100000:2.0:1762166760.482934:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38442:x1847765440024192:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:2.0:1762166760.482984:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38442:x1847765440024192:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.482989:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2566 00000100:00100000:1.0:1762166760.483798:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.483834:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.483855:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440024576 00000100:00100000:0.0:1762166760.483861:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440024576 00000100:00100000:2.0:1762166760.483887:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440024320 00000100:00100000:2.0:1762166760.483892:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440024320 00000100:00100000:0.0:1762166760.483914:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:2.0:1762166760.483942:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 928 00000100:00100000:0.0:1762166760.483944:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc6b0d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38442:x1847765440024576:12345-192.168.204.38@tcp:900:mount.lustre.0 00000100:00100000:2.0:1762166760.483953:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2415:x1847765440024320:12345-192.168.204.38@tcp:8:mount.lustre.0 00000100:00100000:3.0:1762166760.483960:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00080000:2.0:1762166760.483984:0:9168:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp t0 exp 0000000000000000 cur 379 last 0 00000100:00100000:1.0:1762166760.483989:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440024448 00000100:00100000:1.0:1762166760.483995:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440024448 00000100:00100000:0.0:1762166760.484001:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc6b0d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38442:x1847765440024576:12345-192.168.204.38@tcp:900:mount.lustre.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.484011:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000020:00000080:2.0:1762166760.484018:0:9168:0:(genops.c:1402:class_connect()) connect: client fd0f52a9-204e-4869-b8da-3af938f6f960, cookie 0x2f180c4effb0b25b 00000100:00100000:1.0:1762166760.484028:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 929 00002000:00100000:2.0:1762166760.484031:0:9168:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli fd0f52a9-204e-4869-b8da-3af938f6f960/ffff945bc81f6000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1762166760.484039:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2415:x1847765440024448:12345-192.168.204.38@tcp:8:mount.lustre.0 00002000:00100000:2.0:1762166760.484045:0:9168:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:1.0:1762166760.484062:0:9165:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:1.0:1762166760.484088:0:9165:0:(genops.c:1402:class_connect()) connect: client fd0f52a9-204e-4869-b8da-3af938f6f960, cookie 0x2f180c4effb0b262 00002000:00100000:1.0:1762166760.484093:0:9165:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli fd0f52a9-204e-4869-b8da-3af938f6f960/ffff945cc7d3d800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1762166760.484099:0:9165:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:2.0:1762166760.484107:0:9168:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945bc49ab600 00002000:00080000:2.0:1762166760.484118:0:9168:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:01000000:1.0:1762166760.484134:0:9165:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc9241100 00002000:00080000:1.0:1762166760.484141:0:9165:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1762166760.484143:0:9168:0:(import.c:65:import_set_state_nolock()) ffff945bc81f4800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1762166760.484159:0:9165:0:(import.c:65:import_set_state_nolock()) ffff945cc7d39800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1762166760.484188:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:2415:x1847765440024320:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 233us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.484188:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+6:2415:x1847765440024448:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 150us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.484203:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 928 00000100:00100000:1.0:1762166760.484213:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 929 00000100:00100000:3.0:1762166760.484609:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.484662:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440024704 00000100:00100000:1.0:1762166760.484667:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440024704 00000100:00100000:1.0:1762166760.484710:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 738 00000100:00100000:1.0:1762166760.484720:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38442:x1847765440024704:12345-192.168.204.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1762166760.484794:0:6498:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1762166760.484840:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38442:x1847765440024704:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 123us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.484845:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 738 00000100:00100000:0.0:1762166760.562348:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.562442:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440024832 00000100:00100000:2.0:1762166760.562458:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440024832 00000100:00100000:2.0:1762166760.562563:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2567 00000100:00100000:2.0:1762166760.562574:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38487:x1847765440024832:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:2.0:1762166760.562604:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166760.562633:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7814 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.562727:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b270 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.562739:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.562748:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166760.562805:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166760.562809:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166760.562830:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.562855:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7814 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.562875:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7814 expref: 7 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.562884:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166760.562887:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166760.562891:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7000, rc 0) 00000100:00100000:2.0:1762166760.562989:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:38487:x1847765440024832:12345-192.168.204.38@tcp:101:stat.0 Request processed in 416us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.562998:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2567 00000100:00100000:3.0:1762166760.564207:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.564248:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440024960 00000100:00100000:2.0:1762166760.564255:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440024960 00000100:00100000:2.0:1762166760.564291:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2568 00000100:00100000:2.0:1762166760.564297:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:38487:x1847765440024960:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:2.0:1762166760.564329:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166760.564358:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b781b expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.564420:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564436:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564446:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564462:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564470:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564500:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564557:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b28c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564562:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b28c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564566:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b28c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00010000:2.0:1762166760.564588:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b28c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564602:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564615:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564621:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564627:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166760.564631:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564643:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564655:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166760.564657:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166760.564663:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564669:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564678:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564682:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564686:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564688:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166760.564690:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564701:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564706:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xedb28f26 (ffff945cf39a3a00) 00010000:00010000:2.0:1762166760.564707:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166760.564709:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564713:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b285 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xedb28f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.564736:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b781b expref: 9 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.564744:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b28c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b781b expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.564749:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945cf39a3000) 00010000:00010000:2.0:1762166760.564750:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166760.564751:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7a00, rc 0) 00000100:00100000:2.0:1762166760.564796:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:38487:x1847765440024960:12345-192.168.204.38@tcp:101:stat.0 Request processed in 498us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.564803:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2568 00000100:00100000:3.0:1762166760.565639:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166760.565689:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440025088 00000100:00100000:0.0:1762166760.565695:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440025088 00000100:00100000:0.0:1762166760.565728:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:0.0:1762166760.565733:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38487:x1847765440025088:12345-192.168.204.38@tcp:900:stat.0 00000100:00100000:0.0:1762166760.565785:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38487:x1847765440025088:12345-192.168.204.38@tcp:900:stat.0 Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166760.565790:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:0.0:1762166760.566539:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.566574:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440025216 00000100:00100000:2.0:1762166760.566580:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440025216 00000100:00100000:2.0:1762166760.566619:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2569 00000100:00100000:2.0:1762166760.566628:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:38487:x1847765440025216:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:2.0:1762166760.566641:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166760.566674:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0b293 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7822 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.566725:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b29a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.566737:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b29a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.566748:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b29a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:2.0:1762166760.566799:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1762166760.566804:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1762166760.566844:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0b293 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7822 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.566859:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b29a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7822 expref: 7 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.566865:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945cf39a3800) 00010000:00010000:2.0:1762166760.566867:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1762166760.566869:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6c00, rc 0) 00000100:00100000:2.0:1762166760.566902:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:38487:x1847765440025216:12345-192.168.204.38@tcp:101:stat.0 Request processed in 276us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.566908:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2569 00000100:00100000:3.0:1762166760.567868:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166760.567906:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440025344 00000100:00100000:2.0:1762166760.567912:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440025344 00000100:00100000:2.0:1762166760.567955:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2570 00000100:00100000:2.0:1762166760.567964:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:38487:x1847765440025344:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:2.0:1762166760.567979:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166760.567995:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b2a1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7829 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.568033:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.568041:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568047:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568056:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.568060:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568064:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568146:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b2b6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166760.568153:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b2b6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568160:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b2b6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:2.0:1762166760.568194:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000403:0x6:0x0]: returning size 10485760 00000004:00200000:2.0:1762166760.568198:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166760.568212:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b2b6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568223:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b2b6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568238:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568245:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568249:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568253:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166760.568256:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568261:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568268:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945cf39a3800) 00010000:00010000:2.0:1762166760.568270:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166760.568273:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568277:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0b2a8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568285:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568288:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568291:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568294:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166760.568300:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568304:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568308:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x3d8b1ba3 (ffff945cf39a3c00) 00010000:00010000:2.0:1762166760.568309:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166760.568311:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 2/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568314:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b2af lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166760.568333:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b2a1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7829 expref: 9 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.568345:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b2b6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7829 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166760.568351:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3700) 00010000:00010000:2.0:1762166760.568353:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166760.568355:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7200, rc 0) 00000100:00100000:2.0:1762166760.568398:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:38487:x1847765440025344:12345-192.168.204.38@tcp:101:stat.0 Request processed in 434us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.568405:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2570 00000100:00100000:3.0:1762166760.569721:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166760.569802:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440025472 00000100:00100000:1.0:1762166760.569809:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440025472 00000100:00080000:0.0:1762166760.569871:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166760.569874:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 930 00000100:00100000:1.0:1762166760.569883:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+6:2419:x1847765440025472:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:1.0:1762166760.569896:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166760.569910:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b2bd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7830 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166760.569944:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x13:0x0] initial LVB size: 10485760, mtime: 0x690887e7, atime: 0x690887e7, ctime: 0x690887e8, blocks: 0x5000 00010000:00010000:1.0:1762166760.569959:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166760.569960:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166760.569968:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b2bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7830 expref: 7 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166760.569979:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b2bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7830 expref: 7 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166760.569987:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa2b600, rc 0) 00000100:00100000:1.0:1762166760.570028:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2419:x1847765440025472:12345-192.168.204.38@tcp:101:stat.0 Request processed in 138us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166760.570034:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 930 00000100:00100000:3.0:1762166760.722810:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446789376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166760.722932:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166760.723023:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446789376 00000100:00100000:2.0:1762166760.723034:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446789376 00000100:00100000:2.0:1762166760.723114:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1762166760.723128:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446789376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1762166760.723165:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446256640 avail 1300017152 00000100:00100000:2.0:1762166760.723244:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446789376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166760.723253:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1762166760.723302:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446789376:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1762166761.234665:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166762.106152:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.106199:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440025728 00000100:00100000:2.0:1762166762.106209:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440025728 00000100:00080000:0.0:1762166762.106255:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166762.106283:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2571 00000100:00100000:2.0:1762166762.106296:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:38909:x1847765440025728:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:2.0:1762166762.106347:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166762.106374:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b2b6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7829 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.106391:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3700) 00010000:00010000:2.0:1762166762.106402:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166762.106423:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.106435:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106444:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106457:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 3/0,1 mode: --/PW res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.106464:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106470:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106569:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.106587:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106593:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000040:00080000:2.0:1762166762.106800:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1762166762.106810:0:12357:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 381255331362ns, next at 382255329054ns, rc = 0 00000040:00080000:2.0:1762166762.106820:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8776 00010000:00010000:2.0:1762166762.106869:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.106877:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106884:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106890:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106910:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106916:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106946:0:12357:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166762.106964:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106970:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166762.106971:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166762.106979:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.106995:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166762.106997:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166762.107003:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107005:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166762.107011:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107013:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107024:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166762.107052:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3600) 00010000:00010000:0.0:1762166762.107056:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166762.107059:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107061:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff945cf39a3600) 00010000:00010000:0.0:1762166762.107065:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b2d9 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107067:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166762.107073:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166762.107077:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166762.107079:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2d2 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166762.107080:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166762.107083:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166762.107184:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107191:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107196:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107201:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.107203:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107209:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107224:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945cf39a3800) 00010000:00010000:2.0:1762166762.107227:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.107230:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107235:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2c4 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000004:00010000:2.0:1762166762.107244:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005a327f8b reply state 000000001622b3c9 transno 4294967412 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107252:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.107258:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x3d8b1ba3 (ffff945cf39a3a00) 00010000:00010000:2.0:1762166762.107260:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166762.107262:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166762.107335:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+9:38909:x1847765440025728:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1041us (1189us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1762166762.107342:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2571 00010000:00010000:1.0:1762166762.258639:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166762.258670:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446789504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166762.258697:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:3.0:1762166762.258703:0:9159:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 381407222929ns, next at 382407218518ns, rc = 0 00000100:00100000:1.0:1762166762.258719:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446789632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166762.258752:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166762.258796:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166762.258845:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446789504 00000100:00100000:1.0:1762166762.258854:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446789504 00000100:00100000:0.0:1762166762.258860:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446789632 00000100:00100000:0.0:1762166762.258866:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446789632 00000100:00100000:0.0:1762166762.258935:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1762166762.258945:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1762166762.258951:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446789632:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166762.258960:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446789504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166762.258988:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3911946240 avail 3680423936 00002000:00000024:0.0:1762166762.258988:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3911946240 avail 3680423936 00000100:00080000:2.0:1762166762.259015:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166762.259071:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446789504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166762.259080:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446789632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166762.259082:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1762166762.259096:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1762166762.259151:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836646 gen 2 00000004:00080000:1.0:1762166762.259158:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e9f80, transno 21474836646 00000100:00100000:0.0:1762166762.259172:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446789632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166762.259180:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446789504:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1762166762.597677:0:30374:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 44e: basic FLR SOM tests + disable SOM ========================================================== 05:46:02 (1762166762) 00000100:00100000:1.0:1762166762.628636:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.628682:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440025856 00000100:00100000:2.0:1762166762.628692:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440025856 00000100:00080000:0.0:1762166762.628739:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166762.628757:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2572 00000100:00100000:2.0:1762166762.628769:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:39060:x1847765440025856:12345-192.168.204.38@tcp:41:stat.0 00000004:00000024:2.0:1762166762.628818:0:12357:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7835435008 avail 7368171520 00000100:00100000:2.0:1762166762.628898:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:39060:x1847765440025856:12345-192.168.204.38@tcp:41:stat.0 Request processed in 120us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.628907:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2572 00000100:00100000:2.0:1762166762.645230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.645294:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440025984 00000100:00100000:0.0:1762166762.645306:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440025984 00000100:00100000:0.0:1762166762.645364:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2573 00000100:00100000:0.0:1762166762.645377:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:39068:x1847765440025984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166762.645406:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166762.645426:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b2e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7837 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.645512:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645530:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645542:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645603:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645611:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645619:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645658:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645665:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645671:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645676:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166762.645681:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645699:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645712:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166762.645715:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166762.645719:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645725:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b2e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645740:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645746:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645752:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645757:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166762.645759:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645764:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645771:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1ec0156 (ffff945cc29d3e00) 00010000:00010000:0.0:1762166762.645774:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166762.645777:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645783:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b2ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.645837:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b2e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7837 expref: 9 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.645848:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166762.645850:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166762.645854:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b2e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7837 expref: 9 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.645864:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2a00, rc 0) 00000100:00100000:0.0:1762166762.645937:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:39068:x1847765440025984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 559us (710us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166762.645950:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2573 00000100:00100000:0.0:1762166762.647990:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.648035:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440026112 00000100:00100000:2.0:1762166762.648042:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440026112 00000100:00100000:2.0:1762166762.648082:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:2.0:1762166762.648091:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:fd0f52a9-204e-4869-b8da-3af938f6f960+8:39068:x1847765440026112:12345-192.168.204.38@tcp:700:lfs.0 00000100:00100000:2.0:1762166762.648142:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:fd0f52a9-204e-4869-b8da-3af938f6f960+8:39068:x1847765440026112:12345-192.168.204.38@tcp:700:lfs.0 Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.648147:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1762166762.648856:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.648907:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440026368 00000100:00100000:2.0:1762166762.648912:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440026368 00000100:00100000:2.0:1762166762.648950:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2574 00000100:00100000:2.0:1762166762.648958:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:39068:x1847765440026368:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166762.648996:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166762.649017:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b270 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7814 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.649032:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166762.649036:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166762.649083:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.649095:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.649103:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.649115:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.649133:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.649140:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000040:00080000:2.0:1762166762.650102:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].19, 2160 off47376 00000040:00080000:2.0:1762166762.650176:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].7, 2360 off44336 00000004:00080000:2.0:1762166762.650184:0:12357:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945d011c7480 with version 16 00000004:00080000:0.0:1762166762.650221:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 16 rpc_version 16 00000020:00100000:0.0:1762166762.650253:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166762.650262:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc55dd500 x1847765446789888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166762.650285:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446789888:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166762.650323:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166762.650357:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166762.650365:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446789888 00000100:00100000:2.0:1762166762.650371:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446789888 00000100:00100000:2.0:1762166762.650405:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1762166762.650414:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8087:x1847765446789888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166762.650803:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8087:x1847765446789888:12345-0@lo:1000:osp_up1-0.0 Request processed in 391us (477us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1762166762.650811:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1762166762.650864:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446789888:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1762166762.650947:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.650957:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.650965:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.650981:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.650988:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.650994:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651031:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651038:0:12357:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651048:0:12357:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166762.651062:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12357:1847765446790016:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1762166762.651088:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166762.651120:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166762.651123:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446790016 00000100:00100000:3.0:1762166762.651128:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446790016 00000100:00100000:3.0:1762166762.651152:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1762166762.651158:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12357:x1847765446790016:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1762166762.651167:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166762.651179:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0b318 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0b311 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.651193:0:7427:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0b318 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0b311 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.651200:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0b318 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b311 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.651206:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff945cd1ddde00) 00010000:00010000:3.0:1762166762.651208:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166762.651210:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:3.0:1762166762.651243:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:12357:x1847765446790016:12345-0@lo:101:mdt00_004.0 Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166762.651250:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1762166762.651271:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12357:1847765446790016:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1762166762.651284:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.651294:0:12357:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166762.651310:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a0c17f49 reply state 00000000f8ed6410 transno 4294968854 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651320:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651327:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166762.651342:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166762.651345:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166762.651355:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.651374:0:12357:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166762.651383:0:12357:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x7:0x0] 00000004:00010000:2.0:1762166762.651389:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a0c17f49 reply state 00000000f8ed6410 transno 4294968854 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651397:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651402:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166762.651405:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166762.651407:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1762166762.651411:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1762166762.651415:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651421:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651427:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651433:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.651437:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651443:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651451:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166762.651454:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.651463:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651469:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b2f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000004:00010000:2.0:1762166762.651543:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a0c17f49 reply state 00000000f8ed6410 transno 4294968854 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651554:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.651560:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1ec0156 (ffff945bc477f400) 00010000:00010000:2.0:1762166762.651563:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166762.651565:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1762166762.651627:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+9:39068:x1847765440026368:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2667us (2769us total) trans 4294968854 rc 0/0 00000100:00100000:2.0:1762166762.651635:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2574 00000100:00100000:3.0:1762166762.668977:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.669033:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440026496 00000100:00100000:2.0:1762166762.669043:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440026496 00000100:00100000:2.0:1762166762.669098:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2575 00000100:00100000:2.0:1762166762.669111:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+9:39075:x1847765440026496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.669133:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.669152:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b31f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b783e expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.669212:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b326 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.669239:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.669250:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166762.669306:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166762.669310:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166762.669327:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.669350:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b31f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b783e expref: 11 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.669368:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b326 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b783e expref: 10 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.669376:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166762.669379:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166762.669383:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7000, rc 0) 00000100:00100000:2.0:1762166762.669443:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+10:39075:x1847765440026496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 335us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.669451:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2575 00000100:00100000:0.0:1762166762.671106:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.671212:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440026624 00000100:00100000:2.0:1762166762.671219:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440026624 00000100:00100000:2.0:1762166762.671256:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2576 00000100:00100000:2.0:1762166762.671263:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+10:39075:x1847765440026624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.671273:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.671281:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b32d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7845 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.671313:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671320:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671332:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671338:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671343:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671346:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671397:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b342 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671401:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b342 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671404:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b342 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166762.671444:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166762.671447:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1762166762.671456:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b342 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671464:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671470:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671498:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671513:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.671517:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671524:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671533:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166762.671536:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.671540:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671545:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671556:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671562:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671567:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671571:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.671573:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671577:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671582:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1ec0156 (ffff945bc477f400) 00010000:00010000:2.0:1762166762.671583:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.671590:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671593:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b33b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.671609:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b32d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7845 expref: 12 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.671616:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b342 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7845 expref: 11 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.671625:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166762.671626:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1762166762.671628:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6400, rc 0) 00000100:00100000:2.0:1762166762.671655:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39075:x1847765440026624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 394us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.671660:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2576 00000100:00100000:0.0:1762166762.672586:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.672622:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440026752 00000100:00100000:2.0:1762166762.672629:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440026752 00000100:00100000:2.0:1762166762.672660:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1762166762.672666:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39075:x1847765440026752:12345-192.168.204.38@tcp:900:lfs.0 00000100:00100000:2.0:1762166762.672703:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39075:x1847765440026752:12345-192.168.204.38@tcp:900:lfs.0 Request processed in 38us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.672709:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:3.0:1762166762.673401:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.673440:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440026880 00000100:00100000:2.0:1762166762.673444:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440026880 00000100:00100000:2.0:1762166762.673467:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2577 00000100:00100000:2.0:1762166762.673471:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39075:x1847765440026880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.673502:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.673511:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b349 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b784c expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.673538:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b350 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.673545:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b350 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.673551:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b350 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166762.673570:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1762166762.673572:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1762166762.673586:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b349 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b784c expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.673596:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b350 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b784c expref: 12 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.673601:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166762.673602:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166762.673604:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7600, rc 0) 00000100:00100000:2.0:1762166762.673628:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39075:x1847765440026880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 157us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.673633:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2577 00000100:00100000:0.0:1762166762.674455:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.674507:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440027008 00000100:00100000:2.0:1762166762.674511:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440027008 00000100:00100000:2.0:1762166762.674538:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2578 00000100:00100000:2.0:1762166762.674549:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+9:39075:x1847765440027008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.674558:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.674567:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b357 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7853 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.674591:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.674598:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0b318 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b311 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.674604:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 4/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.674626:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0b318 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0b311 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.674635:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446790144:0@lo:104: 00000100:00100000:2.0:1762166762.674662:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166762.674696:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446790144 00000100:00100000:2.0:1762166762.674699:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166762.674701:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446790144 00000100:00100000:3.0:1762166762.674736:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1762166762.674746:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:12357:x1847765446790144:12345-0@lo:104: 00010000:00010000:3.0:1762166762.674757:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.674809:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1762166762.674816:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:12357:x1847765446790144:12345-0@lo:104: Request processed in 72us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166762.674823:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:0.0:1762166762.674824:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1762166762.674831:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765446790144:0@lo:104: 00010000:00010000:0.0:1762166762.674837:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.674847:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6a00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:2.0:1762166762.674848:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166762.674854:0:6482:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1762166762.674864:0:6482:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.674897:0:6482:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.674904:0:6482:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1762166762.674931:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.674939:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc95c6a00/0x2f180c4effb0b311 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b318 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166762.674951:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446790272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166762.674955:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166762.674959:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166762.674960:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166762.674980:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166762.675006:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446790272 00000100:00100000:2.0:1762166762.675011:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446790272 00010000:00010000:2.0:1762166762.675026:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0b318 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0b311 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.675046:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1762166762.675056:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446790272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166762.675062:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1762166762.676214:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967413 is committed 00000004:00080000:3.0:1762166762.676222:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 11 committed 00000001:00080000:3.0:1762166762.676250:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967412 is committed 00000004:00080000:3.0:1762166762.676255:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 7 committed 00000001:00100000:3.0:1762166762.676268:0:7412:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fd0f52a9-204e-4869-b8da-3af938f6f960 00000001:00100000:3.0:1762166762.676275:0:7412:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c5f20b66-016a-4159-9d62-071c0da3ef0b 00000001:00080000:3.0:1762166762.676281:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967411 is committed 00010000:00010000:2.0:1762166762.676281:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.676290:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00000004:00080000:3.0:1762166762.676292:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 10 committed 00010000:00010000:2.0:1762166762.676299:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.676303:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.676307:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.676314:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166762.676326:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x3d8b1ba3 (ffff945cf39a3a00) 00010000:00010000:2.0:1762166762.676328:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166762.676329:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945ceffd4600 refcount 2 committed 0 result 0 batchid 8 00010000:00010000:2.0:1762166762.676331:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000020:00080000:3.0:1762166762.676335:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc70b4200 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ceffd4e40 00010000:00010000:2.0:1762166762.676338:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b2cb lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x3d8b1ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000020:00080000:3.0:1762166762.676342:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc70b4e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc44f9a00 00000100:00100000:1.0:1762166762.676345:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446790400:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1762166762.676355:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446790528:0@lo:6:osp-syn-1-1.0 00000020:00000080:3.0:1762166762.676361:0:7412:0:(genops.c:904:class_export_put()) final put ffff945cc7d3c800/c5f20b66-016a-4159-9d62-071c0da3ef0b 00000020:00080000:2.0:1762166762.676371:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 8 committed batchid 6 00000020:00080000:3.0:1762166762.676377:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 7 batchid updated 00000100:00100000:1.0:1762166762.676388:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1762166762.676409:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff945cc7d3c800/c5f20b66-016a-4159-9d62-071c0da3ef0b for lustre-MDT0001 00000100:00100000:3.0:1762166762.676413:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446790400 00000100:00100000:3.0:1762166762.676418:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446790400 00000020:00080000:2.0:1762166762.676459:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 7 cancel update log [0x240000400:0x2:0x0].7: rc = 0 00000020:00000080:0.0:1762166762.676460:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc2d54800 for lustre-MDT0001 00000100:00100000:3.0:1762166762.676465:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000020:00080000:2.0:1762166762.676473:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 7 00000100:00100000:3.0:1762166762.676507:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446790400:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1762166762.676510:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166762.676532:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446790528 00002000:00080000:3.0:1762166762.676534:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:19 count 1 00010000:00010000:2.0:1762166762.676536:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0b318 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0b311 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166762.676537:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446790528 00010000:00010000:2.0:1762166762.676556:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff945cd1ddde00) 00010000:00010000:2.0:1762166762.676559:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00002000:00010000:3.0:1762166762.676561:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 10485760, mtime: 0x690887e7, atime: 0x690887e7, ctime: 0x690887e8, blocks: 0x5000 00010000:00010000:2.0:1762166762.676566:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166762.676570:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676572:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00000100:00080000:0.0:1762166762.676574:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166762.676582:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00010000:00010000:3.0:1762166762.676593:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166762.676594:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446790528:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1762166762.676598:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.676602:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166762.676605:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1762166762.676607:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:18 count 1 00010000:00010000:0.0:1762166762.676608:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00002000:00010000:1.0:1762166762.676626:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x12:0x0] initial LVB size: 10485760, mtime: 0x690887e7, atime: 0x690887e7, ctime: 0x690887e8, blocks: 0x5000 00010000:00010000:3.0:1762166762.676630:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.676632:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446790272:12345-0@lo:103:ldlm_bl.0 Request processed in 1574us (1649us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166762.676632:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166762.676643:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.676650:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00010000:00010000:3.0:1762166762.676659:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.676660:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166762.676663:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166762.676668:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.676672:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166762.676675:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x7:0x0]: returning size 4096 00010000:00010000:1.0:1762166762.676678:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166762.676681:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1762166762.676691:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.676696:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.676697:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446790272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166762.676698:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166762.676708:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b357 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7853 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.676719:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762166762.676721:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166762.676721:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7853 expref: 7 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676727:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.676729:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff945cd1ddde00) 00010000:00010000:0.0:1762166762.676736:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166762.676738:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166762.676740:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1600, rc 0) 00010000:00010000:2.0:1762166762.676744:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676754:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676768:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166762.676782:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:39075:x1847765440027008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2231us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166762.676795:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2578 00010000:00010000:2.0:1762166762.676796:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0b365 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676813:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166762.676816:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676820:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2ba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166762.676823:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676828:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676835:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676838:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2ba00/0x2f180c4effb0b36c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.676849:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166762.676850:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166762.676853:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166762.676868:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166762.677909:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.677946:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440027136 00000100:00100000:2.0:1762166762.677951:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440027136 00000100:00100000:2.0:1762166762.677988:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2579 00000100:00100000:2.0:1762166762.678004:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39075:x1847765440027136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.678014:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.678025:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0b373 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b785a expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.678062:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678071:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678078:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678090:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678097:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678103:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678139:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678145:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678151:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678156:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.678159:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678172:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678182:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166762.678185:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.678188:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678194:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b37a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678205:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678211:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678217:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678220:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.678222:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678226:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678232:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945bc477fa00) 00010000:00010000:2.0:1762166762.678234:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.678236:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678239:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b381 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.678267:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0b373 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b785a expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.678273:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166762.678275:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.678277:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0b373 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b785a expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.678284:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0400, rc 0) 00000100:00100000:2.0:1762166762.678309:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39075:x1847765440027136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 308us (400us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166762.678314:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2579 00000100:00100000:0.0:1762166762.679294:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.679333:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440027264 00000100:00100000:2.0:1762166762.679339:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440027264 00000100:00100000:2.0:1762166762.679372:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2580 00000100:00100000:2.0:1762166762.679381:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39075:x1847765440027264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.679391:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.679400:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7861 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.679432:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1e00/0x2f180c4effb0b38f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.679440:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1e00/0x2f180c4effb0b38f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.679517:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1e00/0x2f180c4effb0b38f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166762.679576:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166762.679580:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1762166762.679592:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1e00/0x2f180c4effb0b38f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.679610:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7861 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.679623:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1e00/0x2f180c4effb0b38f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7861 expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.679630:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166762.679632:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166762.679635:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1e00, rc 0) 00000100:00100000:2.0:1762166762.679666:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:39075:x1847765440027264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 286us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.679689:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2580 00000100:00100000:0.0:1762166762.681560:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.681613:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440027520 00000100:00100000:2.0:1762166762.681620:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440027520 00000100:00100000:2.0:1762166762.681661:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2581 00000100:00100000:2.0:1762166762.681671:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:39075:x1847765440027520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.681683:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.681686:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166762.681703:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b350 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b784c expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.681719:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166762.681730:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166762.681741:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0b396 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7868 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.681831:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.681841:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.681850:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.681863:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.681869:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.681876:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682260:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682267:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682272:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166762.682278:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 0 00010000:00010000:2.0:1762166762.682295:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682306:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682311:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682314:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.682317:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682322:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682328:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166762.682330:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.682333:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682337:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b39d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000004:00010000:2.0:1762166762.682344:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000740fec8e reply state 0000000015b36982 transno 4294968855 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682350:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.682354:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945bc477f000) 00010000:00010000:2.0:1762166762.682356:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166762.682358:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166762.682375:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0b396 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.682394:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.682398:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477fc00) 00010000:00010000:2.0:1762166762.682400:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166762.682402:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1000, rc 0) 00000100:00100000:2.0:1762166762.682438:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+15:39075:x1847765440027520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 771us (882us total) trans 4294968855 rc 0/0 00000100:00100000:2.0:1762166762.682443:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2581 00000100:00100000:1.0:1762166762.683852:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.683899:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440027776 00000100:00100000:2.0:1762166762.683906:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440027776 00000100:00100000:2.0:1762166762.683946:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2582 00000100:00100000:2.0:1762166762.683957:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+15:39075:x1847765440027776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.683988:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.684000:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0b3b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b786f expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.684058:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.684069:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.684077:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.684105:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.684126:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 16 pid: 12357 timeout: 481 lvb_type: 0 00000100:00100000:2.0:1762166762.684139:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446790656:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166762.684203:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166762.684989:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446790656:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166762.685010:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:1.0:1762166762.685215:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166762.685270:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440027904 00000100:00100000:3.0:1762166762.685275:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440027904 00010000:00010000:3.0:1762166762.685292:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 17 pid: 12357 timeout: 481 lvb_type: 0 00000100:00100000:3.0:1762166762.685317:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 614 00000100:00100000:3.0:1762166762.685323:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+17:2418:x1847765440027904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166762.685331:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166762.685341:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 17 pid: 12357 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1762166762.685350:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 17 pid: 12357 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1762166762.685361:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1000/0x2f180c4effb0b3ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7868 expref: 17 pid: 12357 timeout: 481 lvb_type: 0 00010000:00010000:3.0:1762166762.685372:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477fc00) 00010000:00010000:3.0:1762166762.685375:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166762.685380:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166762.685384:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166762.685402:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166762.685420:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.685430:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:3.0:1762166762.685434:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+16:2418:x1847765440027904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 109us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166762.685443:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 614 00000004:00200000:1.0:1762166762.685458:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 0 00000100:00100000:0.0:1762166762.685503:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446790528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8909us (8993us total) trans 17179869341 rc 0/0 00000100:00100000:0.0:1762166762.685513:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000004:00080000:3.0:1762166762.685530:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe31880/2, rc 0, transno 17179869341 00000100:00100000:3.0:1762166762.685548:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446790528:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1762166762.685673:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3c:0x0], index 1: 0 00000004:00080000:1.0:1762166762.685682:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3f:0x0], index 0: 0 00010000:00010000:1.0:1762166762.685768:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.685775:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.685778:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.685782:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166762.685784:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.685789:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.685795:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477fc00) 00010000:00010000:1.0:1762166762.685797:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166762.685799:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.685802:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0a00/0x2f180c4effb0b3c0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.685828:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0b3b9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b786f expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.685834:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477fc00) 00010000:00010000:1.0:1762166762.685840:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166762.685844:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0b3b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b786f expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.685856:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1c00, rc 0) 00000100:00100000:1.0:1762166762.685895:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+15:39075:x1847765440027776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1930us (2033us total) trans 4294968856 rc 301/301 00000100:00100000:1.0:1762166762.685902:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2582 00000100:00100000:2.0:1762166762.686517:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446790400:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10042us (10129us total) trans 21474836655 rc 0/0 00000100:00100000:2.0:1762166762.686526:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000004:00080000:1.0:1762166762.686542:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6c000/2, rc 0, transno 21474836655 00000100:00100000:1.0:1762166762.686549:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446790400:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166762.686988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.687023:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440028160 00000100:00100000:0.0:1762166762.687027:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440028160 00000100:00100000:0.0:1762166762.687053:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 739 00000100:00100000:0.0:1762166762.687058:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+15:39075:x1847765440028160:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166762.687177:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+16:39075:x1847765440028160:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 119us (189us total) trans 4294968857 rc 0/0 00000100:00100000:0.0:1762166762.687183:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 739 00000100:00100000:3.0:1762166762.687786:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.687817:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440028416 00000100:00100000:0.0:1762166762.687821:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440028416 00000100:00100000:0.0:1762166762.687846:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 740 00000100:00100000:0.0:1762166762.687853:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+16:39075:x1847765440028416:12345-192.168.204.38@tcp:35:lfs.0 00000001:00080000:3.0:1762166762.688864:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968858 is committed 00000001:00100000:3.0:1762166762.688878:0:6475:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fd0f52a9-204e-4869-b8da-3af938f6f960 00000001:00100000:3.0:1762166762.688892:0:6475:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5f20b66-016a-4159-9d62-071c0da3ef0b 00010000:00010000:1.0:1762166762.688892:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00000001:00080000:3.0:1762166762.688899:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968853 is committed 00010000:00010000:1.0:1762166762.688901:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00000020:00000080:3.0:1762166762.688910:0:6475:0:(genops.c:904:class_export_put()) final put ffff945bc4384000/c5f20b66-016a-4159-9d62-071c0da3ef0b 00010000:00010000:1.0:1762166762.688910:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.688917:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166762.688919:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00000001:00080000:3.0:1762166762.688924:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968851 is committed 00010000:00010000:1.0:1762166762.688924:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.688938:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1ec0156 (ffff945bc477f400) 00010000:00010000:1.0:1762166762.688941:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166762.688945:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000020:00000080:0.0:1762166762.688946:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc4384000/c5f20b66-016a-4159-9d62-071c0da3ef0b for lustre-MDT0000 00010000:00010000:1.0:1762166762.688965:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b2fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.688985:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.688991:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.688997:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689002:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7200 already unused, calling callback (ffffffffc18e2310) 00000020:00000080:0.0:1762166762.689004:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc4384800 for lustre-MDT0000 00010000:00010000:1.0:1762166762.689006:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689014:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166762.689023:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39075:x1847765440028416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1170us (1238us total) trans 4294968858 rc 0/0 00010000:00010000:1.0:1762166762.689023:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff945bc477f700) 00010000:00010000:1.0:1762166762.689026:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166762.689029:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166762.689031:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 740 00010000:00010000:1.0:1762166762.689035:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0b303 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689045:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689050:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689056:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689068:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166762.689071:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689076:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689083:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477f500) 00010000:00010000:1.0:1762166762.689085:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166762.689087:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689090:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b30a lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689101:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689104:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689108:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689111:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166762.689113:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689116:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689119:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945bc477f000) 00010000:00010000:1.0:1762166762.689124:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166762.689127:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166762.689130:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0b3a4 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:1.0:1762166762.707125:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.707195:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440028672 00000100:00100000:2.0:1762166762.707205:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440028672 00000100:00100000:2.0:1762166762.707254:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2583 00000100:00100000:2.0:1762166762.707263:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+9:39081:x1847765440028672:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166762.707283:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.707304:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0b3ce lrc: 2/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7876 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.707418:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707431:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707442:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707463:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707468:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707472:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707535:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0b3e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707540:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0b3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707544:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0b3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166762.707551:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 0 00010000:00010000:2.0:1762166762.707636:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707643:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707649:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707654:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.707659:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707665:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707681:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166762.707684:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.707689:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707694:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b3d5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707707:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707713:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707717:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707722:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.707724:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707729:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707734:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945bc477f900) 00010000:00010000:2.0:1762166762.707737:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.707739:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707744:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b3dc lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.707780:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0b3ce lrc: 0/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7876 expref: 12 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.707802:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0b3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7876 expref: 11 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.707810:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477fd00) 00010000:00010000:2.0:1762166762.707812:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166762.707815:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0400, rc 0) 00000100:00100000:2.0:1762166762.707878:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39081:x1847765440028672:12345-192.168.204.38@tcp:101:dd.0 Request processed in 617us (763us total) trans 4294968859 rc 0/0 00000100:00100000:2.0:1762166762.707894:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2583 00000100:00100000:3.0:1762166762.709332:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.709376:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440028800 00000100:00100000:2.0:1762166762.709382:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440028800 00000100:00100000:2.0:1762166762.709413:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 741 00000100:00100000:2.0:1762166762.709419:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39081:x1847765440028800:12345-192.168.204.38@tcp:49:dd.0 00000100:00100000:2.0:1762166762.709497:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39081:x1847765440028800:12345-192.168.204.38@tcp:49:dd.0 Request processed in 78us (168us total) trans 0 rc -61/-61 00000100:00100000:2.0:1762166762.709502:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 741 00000100:00100000:3.0:1762166762.710153:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.710191:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440029056 00000100:00100000:2.0:1762166762.710195:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440029056 00000100:00100000:2.0:1762166762.710220:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2584 00000100:00100000:2.0:1762166762.710226:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39081:x1847765440029056:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:2.0:1762166762.710247:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166762.710264:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0b3e3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7876 expref: 11 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.710276:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477fd00) 00010000:00010000:2.0:1762166762.710290:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166762.710394:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.710404:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.710409:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000001:00080000:2.0:1762166762.710442:0:12357:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968860 00000004:00010000:2.0:1762166762.710455:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e12107cf reply state 000000003958540e transno 4294968861 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.710464:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.710468:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.710469:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166762.710471:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166762.710533:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:39081:x1847765440029056:12345-192.168.204.38@tcp:36:dd.0 Request processed in 307us (380us total) trans 4294968861 rc 0/0 00000100:00100000:2.0:1762166762.710537:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2584 00000020:00080000:2.0:1762166762.710540:0:12357:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166762.711269:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.711314:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440029184 00000100:00100000:2.0:1762166762.711320:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440029184 00000100:00100000:2.0:1762166762.711352:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2585 00000100:00100000:2.0:1762166762.711362:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:39081:x1847765440029184:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166762.711374:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.711383:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b3f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b787d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.711432:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b787d expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.711444:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b787d expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.711462:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.711464:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166762.711466:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0600, rc 0) 00000100:00100000:2.0:1762166762.711504:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39081:x1847765440029184:12345-192.168.204.38@tcp:101:dd.0 Request processed in 145us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.711509:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2585 00000100:00100000:3.0:1762166762.712905:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.712940:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440029440 00000100:00100000:2.0:1762166762.712946:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440029440 00000100:00100000:2.0:1762166762.712981:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2586 00000100:00100000:2.0:1762166762.712990:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39081:x1847765440029440:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166762.713001:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.713004:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166762.713018:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0600/0x2f180c4effb0b3f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b787d expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.713031:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.713034:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166762.713041:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0b3ff lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7884 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.713067:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0800/0x2f180c4effb0b406 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.713082:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0800/0x2f180c4effb0b406 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.713090:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0800/0x2f180c4effb0b406 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000040:00080000:2.0:1762166762.713257:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].99, 88 off16256 00000004:00080000:2.0:1762166762.713266:0:12357:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381861788221ns, next at 376358321105ns, rc = 0 00000040:00080000:2.0:1762166762.713305:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].104, 88 off16648 00000004:00080000:2.0:1762166762.713314:0:12357:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381861835967ns, next at 376358357885ns, rc = 0 00000001:00080000:3.0:1762166762.714290:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968862 is committed 00000004:00080000:3.0:1762166762.714296:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00000004:00080000:3.0:1762166762.714306:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00010000:00010000:2.0:1762166762.714312:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.714322:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.714327:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.714332:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166762.714335:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.714339:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.714348:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.714351:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166762.714355:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.714359:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0b3f1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:1.0:1762166762.714383:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446790784:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762166762.714403:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0800/0x2f180c4effb0b406 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7884 expref: 11 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.714409:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.714411:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1762166762.714420:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446790912:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166762.714421:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0b3ff lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7884 expref: 11 pid: 12357 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1762166762.714428:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166762.714438:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0800/0x2f180c4effb0b406 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7884 expref: 10 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.714451:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.714453:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166762.714455:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0800, rc 0) 00000100:00100000:3.0:1762166762.714467:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446790784 00000100:00100000:0.0:1762166762.714468:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166762.714498:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446790784 00000100:00100000:2.0:1762166762.714510:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+10:39081:x1847765440029440:12345-192.168.204.38@tcp:101:dd.0 Request processed in 1522us (1605us total) trans 4294968862 rc 0/0 00000100:00100000:2.0:1762166762.714517:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2586 00000100:00100000:3.0:1762166762.714555:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446790912 00000100:00100000:2.0:1762166762.714560:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1762166762.714561:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446790912 00000100:00100000:2.0:1762166762.714573:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446790784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166762.714618:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00080000:0.0:1762166762.714633:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166762.714687:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446790912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166762.714738:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446790784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (313us total) trans 21474836656 rc 0/0 00000100:00100000:2.0:1762166762.714745:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000004:00080000:1.0:1762166762.714792:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b6d80/2, rc 0, transno 21474836656 00000100:00100000:1.0:1762166762.714799:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446790784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166762.714863:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446790912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (395us total) trans 17179869342 rc 0/0 00000100:00100000:3.0:1762166762.714871:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000004:00080000:0.0:1762166762.714875:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef4700/2, rc 0, transno 17179869342 00000100:00100000:0.0:1762166762.714880:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446790912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166762.716162:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.716196:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440029568 00000100:00100000:2.0:1762166762.716201:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440029568 00000100:00100000:2.0:1762166762.716240:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 935 00000100:00080000:0.0:1762166762.716244:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166762.716249:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+7:39081:x1847765440029568:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166762.716269:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.716283:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b788b expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166762.716296:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166762.716308:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.716310:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.716315:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.716324:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.716331:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1400, rc 0) 00000100:00100000:2.0:1762166762.716356:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+8:39081:x1847765440029568:12345-192.168.204.38@tcp:101:dd.0 Request processed in 110us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.716361:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 935 00000100:00100000:1.0:1762166762.717328:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.717379:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440029696 00000100:00100000:0.0:1762166762.717385:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440029696 00002000:00010000:0.0:1762166762.717407:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/60 (0->18446744073709551615) 00002000:00100000:0.0:1762166762.717411:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b7100 with x1847765440029696 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166762.717418:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b7100. 00000100:00100000:0.0:1762166762.717439:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 452 00000100:00100000:0.0:1762166762.717446:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+8:2419:x1847765440029696:12345-192.168.204.38@tcp:10:dd.0 00000001:00080000:2.0:1762166762.718293:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869343 is committed 00000001:00080000:2.0:1762166762.718301:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869342 is committed 00000001:00080000:2.0:1762166762.718305:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869341 is committed 00000001:00100000:2.0:1762166762.718307:0:25941:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd0f52a9-204e-4869-b8da-3af938f6f960 00000001:00100000:2.0:1762166762.718310:0:25941:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5f20b66-016a-4159-9d62-071c0da3ef0b 00000001:00080000:2.0:1762166762.718315:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869339 is committed 00000020:00000080:2.0:1762166762.718316:0:25941:0:(genops.c:904:class_export_put()) final put ffff945bc4382800/c5f20b66-016a-4159-9d62-071c0da3ef0b 00000020:00000080:0.0:1762166762.718352:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc4382800/c5f20b66-016a-4159-9d62-071c0da3ef0b for lustre-OST0001 00000020:00000080:0.0:1762166762.718396:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cf4176000 for lustre-OST0001 00002000:00010000:1.0:1762166762.718408:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166762.718413:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb mtime from disk: 0 -> 1762166762 00002000:00010000:1.0:1762166762.718416:0:16567:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166762.718419:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb ctime from disk: 0 -> 1762166762 00002000:00010000:1.0:1762166762.718421:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166762.718468:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2419:x1847765440029696:12345-192.168.204.38@tcp:10:dd.0 Request processed in 1020us (1140us total) trans 17179869343 rc 0/0 00000100:00100000:1.0:1762166762.718498:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 452 00002000:00010000:1.0:1762166762.718503:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/60 (0->18446744073709551615) 00002000:00100000:1.0:1762166762.718506:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b7100 with x1847765440029696 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166762.718512:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b7100. 00000100:00100000:3.0:1762166762.768360:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166762.768509:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440029824 00000100:00100000:1.0:1762166762.768523:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440029824 00002000:00100000:1.0:1762166762.768590:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x3c:0x0] (0->4194303) req@ffff945bc5bbaa00 x1847765440029824/t0(0) o4->fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp:548/0 lens 488/0 e 0 to 0 dl 1762166773 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166762.768618:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbaa00 with x1847765440029824 ext(0->4194303) 00002000:00010000:1.0:1762166762.768626:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbaa00 00000100:00100000:1.0:1762166762.768671:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 453 00000100:00100000:1.0:1762166762.768682:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2418:x1847765440029824:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:1.0:1762166762.786075:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+9:2418:x1847765440029824:12345-192.168.204.38@tcp:4:dd.0 Request processed in 17383us (17719us total) trans 17179869344 rc 0/0 00000100:00100000:1.0:1762166762.786092:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 453 00002000:00100000:1.0:1762166762.786107:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x3c:0x0] (0->4194303) req@ffff945bc5bbaa00 x1847765440029824/t17179869344(0) o4->fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp:548/0 lens 488/448 e 0 to 0 dl 1762166773 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166762.786117:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbaa00 with x1847765440029824 ext(0->4194303) 00002000:00010000:1.0:1762166762.786123:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbaa00 00000100:00100000:2.0:1762166762.803839:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166762.803916:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440029952 00000100:00100000:1.0:1762166762.803928:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440029952 00002000:00100000:1.0:1762166762.803988:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x3c:0x0] (4194304->8388607) req@ffff945bc4a0a300 x1847765440029952/t0(0) o4->fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp:548/0 lens 488/0 e 0 to 0 dl 1762166773 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166762.804000:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a0a300 with x1847765440029952 ext(4194304->8388607) 00002000:00010000:1.0:1762166762.804006:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a0a300 00000100:00100000:1.0:1762166762.804038:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 454 00000100:00100000:1.0:1762166762.804050:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+9:2419:x1847765440029952:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:1.0:1762166762.817342:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:2419:x1847765440029952:12345-192.168.204.38@tcp:4:dd.0 Request processed in 13287us (13505us total) trans 17179869345 rc 0/0 00000100:00100000:1.0:1762166762.817355:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 454 00002000:00100000:1.0:1762166762.817373:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x3c:0x0] (4194304->8388607) req@ffff945bc4a0a300 x1847765440029952/t17179869345(0) o4->fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp:548/0 lens 488/448 e 0 to 0 dl 1762166773 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166762.817380:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a0a300 with x1847765440029952 ext(4194304->8388607) 00002000:00010000:1.0:1762166762.817385:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a0a300 00000100:00100000:3.0:1762166762.823990:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.824046:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440030208 00000100:00100000:2.0:1762166762.824054:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440030208 00000100:00100000:2.0:1762166762.824113:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 742 00000100:00100000:2.0:1762166762.824120:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+10:39081:x1847765440030208:12345-192.168.204.38@tcp:35:dd.0 00000001:00080000:2.0:1762166762.824294:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968863 00000100:00100000:2.0:1762166762.824392:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39081:x1847765440030208:12345-192.168.204.38@tcp:35:dd.0 Request processed in 273us (409us total) trans 4294968864 rc 0/0 00000100:00100000:2.0:1762166762.824398:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 742 00000020:00080000:2.0:1762166762.824401:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166762.831414:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166762.831503:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440030336 00000100:00100000:1.0:1762166762.831514:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440030336 00002000:00100000:1.0:1762166762.831550:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x3c:0x0] (8388608->10485759) req@ffff945bc4a08700 x1847765440030336/t0(0) o4->fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp:548/0 lens 488/0 e 0 to 0 dl 1762166773 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166762.831568:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a08700 with x1847765440030336 ext(8388608->10485759) 00002000:00010000:1.0:1762166762.831573:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a08700 00000100:00100000:1.0:1762166762.831600:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 455 00000100:00100000:1.0:1762166762.831609:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:2418:x1847765440030336:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:1.0:1762166762.839736:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2418:x1847765440030336:12345-192.168.204.38@tcp:4:dd.0 Request processed in 8120us (8321us total) trans 17179869346 rc 0/0 00000100:00100000:1.0:1762166762.839747:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 455 00002000:00100000:1.0:1762166762.839757:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x3c:0x0] (8388608->10485759) req@ffff945bc4a08700 x1847765440030336/t17179869346(0) o4->fd0f52a9-204e-4869-b8da-3af938f6f960@192.168.204.38@tcp:548/0 lens 488/448 e 0 to 0 dl 1762166773 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166762.839764:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a08700 with x1847765440030336 ext(8388608->10485759) 00002000:00010000:1.0:1762166762.839770:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a08700 00000100:00100000:2.0:1762166762.846623:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.846688:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440030464 00000100:00100000:0.0:1762166762.846711:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440030464 00000100:00100000:0.0:1762166762.846765:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2587 00000100:00100000:0.0:1762166762.846773:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39083:x1847765440030464:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:0.0:1762166762.846792:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166762.846808:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b414 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7892 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.846867:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.846877:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.846896:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.846905:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.846909:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.846912:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.846979:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.846987:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.846994:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:0.0:1762166762.847040:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 10485760 00000004:00200000:0.0:1762166762.847044:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166762.847065:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847076:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847082:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847085:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847089:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847093:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166762.847095:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847099:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847107:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945cc29d3e00) 00010000:00010000:0.0:1762166762.847109:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166762.847111:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847115:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b41b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847122:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847130:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847133:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847136:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166762.847138:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847141:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847144:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945cc29d3d00) 00010000:00010000:0.0:1762166762.847146:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166762.847147:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847150:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b422 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.847169:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b414 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.847177:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.847182:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166762.847183:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166762.847185:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3200, rc 0) 00000100:00100000:0.0:1762166762.847230:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:39083:x1847765440030464:12345-192.168.204.38@tcp:101:stat.0 Request processed in 459us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166762.847239:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2587 00000100:00100000:3.0:1762166762.854680:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.854734:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440030720 00000100:00100000:0.0:1762166762.854745:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440030720 00000100:00100000:0.0:1762166762.854796:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2588 00000100:00100000:0.0:1762166762.854807:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:39084:x1847765440030720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166762.854836:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166762.854854:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b430 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7899 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.854967:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.854982:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.854990:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.855023:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.855035:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 14 pid: 12357 timeout: 482 lvb_type: 0 00000100:00100000:0.0:1762166762.855048:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446791040:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166762.855151:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166762.856026:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446791040:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166762.856043:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:3.0:1762166762.856305:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.856805:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440030848 00000100:00100000:2.0:1762166762.856812:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440030848 00010000:00010000:2.0:1762166762.856837:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 15 pid: 12357 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1762166762.856868:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 615 00000100:00100000:2.0:1762166762.856876:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+15:2418:x1847765440030848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166762.856901:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166762.856907:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 15 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.856920:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 15 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.856941:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b429 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7892 expref: 15 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.856952:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.856955:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.856966:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.856971:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.856989:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166762.857021:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166762.857022:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+14:2418:x1847765440030848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.857036:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 615 00010000:00010000:0.0:1762166762.857036:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:0.0:1762166762.857057:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 10485760 00010000:00010000:0.0:1762166762.857166:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b430 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.857180:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.857187:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166762.857190:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166762.857193:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3a00, rc 0) 00000100:00100000:0.0:1762166762.857243:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39084:x1847765440030720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2438us (2571us total) trans 4294968865 rc 0/0 00000100:00100000:0.0:1762166762.857251:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2588 00000100:00100000:3.0:1762166762.858448:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.858498:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440030976 00000100:00100000:0.0:1762166762.858503:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440030976 00000100:00100000:0.0:1762166762.858531:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2589 00000100:00100000:0.0:1762166762.858536:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39084:x1847765440030976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166762.858550:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166762.858560:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b445 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78a0 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.858624:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.858640:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.858645:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.858663:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.858671:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 15 pid: 12357 timeout: 482 lvb_type: 0 00000100:00100000:0.0:1762166762.858680:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446791168:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166762.858723:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166762.860458:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.860528:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446791168:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166762.860530:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440031104 00000100:00100000:2.0:1762166762.860542:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440031104 00010000:00010000:0.0:1762166762.860555:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.860589:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 16 pid: 12357 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1762166762.860627:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 616 00000100:00100000:2.0:1762166762.860638:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+16:2418:x1847765440031104:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166762.860652:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166762.860658:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 16 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.860668:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 16 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.860687:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b437 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7899 expref: 16 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.860701:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.860710:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.860718:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.860726:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.860754:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166762.860779:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.860788:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166762.860814:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+15:2418:x1847765440031104:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 177us (361us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166762.860825:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 10485760 00000004:00200000:0.0:1762166762.860833:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1762166762.860839:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 616 00000004:00010000:0.0:1762166762.860856:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.860904:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b445 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78a0 expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.860936:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78a0 expref: 14 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.860944:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166762.860948:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166762.860952:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2a00, rc 0) 00000100:00100000:0.0:1762166762.861000:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39084:x1847765440030976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2463us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166762.861009:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2589 00000100:00100000:3.0:1762166762.862208:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.862247:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440031360 00000100:00100000:0.0:1762166762.862254:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440031360 00000100:00100000:0.0:1762166762.862290:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2590 00000100:00100000:0.0:1762166762.862296:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39084:x1847765440031360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166762.862308:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166762.862323:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b453 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78a7 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.862388:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b45a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.862399:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b45a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.862409:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b45a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:0.0:1762166762.862418:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 10485760 00010000:00010000:0.0:1762166762.862520:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b453 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78a7 expref: 17 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.862537:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b45a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78a7 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.862541:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166762.862543:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166762.862545:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3800, rc 0) 00000100:00100000:0.0:1762166762.862571:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+16:39084:x1847765440031360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 276us (367us total) trans 4294968866 rc 0/0 00000100:00100000:0.0:1762166762.862575:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2590 00000100:00100000:1.0:1762166762.863549:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.863602:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440031488 00000100:00100000:2.0:1762166762.863610:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440031488 00000100:00100000:2.0:1762166762.863654:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 936 00000100:00100000:2.0:1762166762.863666:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2418:x1847765440031488:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166762.863708:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.863731:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.863740:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166762.863743:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166762.863747:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.863784:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.863815:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 13 pid: 9165 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1762166762.863845:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446791296:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166762.863941:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166762.864812:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446791296:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166762.864841:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166762.869685:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.869755:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440031616 00000100:00100000:2.0:1762166762.869768:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440031616 00010000:00010000:2.0:1762166762.869824:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 14 pid: 9165 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1762166762.869906:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 617 00000100:00100000:2.0:1762166762.869917:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cd425a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+14:2418:x1847765440031616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166762.869933:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1762166762.869956:0:6481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:2.0:1762166762.869960:0:6481:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb mtime from disk: 1762166762 -> 1762166763 00002000:00010000:2.0:1762166762.869963:0:6481:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb ctime from disk: 1762166762 -> 1762166763 00002000:00010000:2.0:1762166762.869965:0:6481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb blocks from disk: 0 -> 20480 00010000:00010000:2.0:1762166762.869979:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 14 pid: 9165 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.870017:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 14 pid: 9165 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.870041:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0b40d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b788b expref: 14 pid: 9165 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.870055:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.870057:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.870061:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.870069:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.870103:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166762.870147:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.870161:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.870185:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cd425a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2418:x1847765440031616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 268us (505us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166762.870195:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.870195:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 617 00010000:00010000:3.0:1762166762.870207:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.870217:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.870225:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166762.870230:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.870239:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.870253:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.870261:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0b468 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166762.870319:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+12:2418:x1847765440031488:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 6655us (6770us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166762.870329:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 936 00000100:00100000:3.0:1762166762.871568:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.871646:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440031872 00000100:00100000:0.0:1762166762.871657:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440031872 00000100:00100000:0.0:1762166762.871719:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2591 00000100:00100000:0.0:1762166762.871729:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+16:39084:x1847765440031872:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166762.871807:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166762.871832:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b44c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78a0 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.871854:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0800/0x2f180c4effb0b406 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7884 expref: 15 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.871867:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166762.871872:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166762.871922:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.871937:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.871962:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000040:00080000:0.0:1762166762.872227:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].100, 88 off16344 00000004:00080000:0.0:1762166762.872237:0:12357:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382020758700ns, next at 376358321105ns, rc = 0 00000040:00080000:0.0:1762166762.872285:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].105, 88 off16736 00000004:00080000:0.0:1762166762.872291:0:12357:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382020813048ns, next at 376358357885ns, rc = 0 00000001:00080000:3.0:1762166762.873705:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968867 is committed 00000004:00080000:3.0:1762166762.873714:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00000004:00080000:3.0:1762166762.873727:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 92 committed 00000004:00010000:2.0:1762166762.873854:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000012e188f9 reply state 00000000b99e2775 transno 4294968867 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:3.0:1762166762.873857:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446791424:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166762.873888:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.873899:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.873902:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166762.873907:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166762.873928:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166762.874002:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:2.0:1762166762.874003:0:12357:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762166762.874010:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446791552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166762.874030:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39084:x1847765440031872:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2301us (2475us total) trans 4294968867 rc 0/0 00000100:00100000:2.0:1762166762.874041:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2591 00000100:00100000:3.0:1762166762.874047:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166762.874072:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166762.874075:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446791424 00010000:00010000:2.0:1762166762.874080:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166762.874083:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446791424 00010000:00010000:2.0:1762166762.874088:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00000100:00100000:3.0:1762166762.874092:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446791552 00010000:00010000:2.0:1762166762.874094:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3200 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166762.874098:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446791552 00010000:00010000:2.0:1762166762.874100:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.874108:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.874120:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.874122:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166762.874126:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166762.874130:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00010000:00010000:2.0:1762166762.874132:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b46f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166762.874140:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446791424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166762.874150:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:3.0:1762166762.874162:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446791552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166762.874289:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446791424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (363us total) trans 17179869347 rc 0/0 00000100:00100000:0.0:1762166762.874296:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1762166762.874334:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446791552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (290us total) trans 21474836657 rc 0/0 00000100:00100000:1.0:1762166762.874336:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869342 gen 2 00000100:00100000:3.0:1762166762.874341:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000004:00080000:1.0:1762166762.874344:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef4700, transno 17179869342 00000100:00100000:1.0:1762166762.874363:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bcbe35c00 x1847765446791424/t17179869347(17179869347) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166778 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166762.874380:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe35c00/2, rc 0, transno 17179869347 00000100:00100000:1.0:1762166762.874385:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446791424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762166762.874400:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b7b80/2, rc 0, transno 21474836657 00000100:00100000:1.0:1762166762.874405:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446791552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166762.875226:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.875264:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440032000 00000100:00100000:2.0:1762166762.875270:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440032000 00000100:00100000:2.0:1762166762.875301:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2592 00000100:00100000:2.0:1762166762.875309:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+10:39084:x1847765440032000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.875324:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.875340:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78ae expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.875370:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 11 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.875379:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 11 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.875389:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.875391:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166762.875393:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0e00, rc 0) 00000100:00100000:2.0:1762166762.875421:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39084:x1847765440032000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 115us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.875426:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2592 00000100:00100000:1.0:1762166762.877100:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.877148:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440032128 00000100:00100000:2.0:1762166762.877156:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440032128 00000100:00100000:2.0:1762166762.877197:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2593 00000100:00100000:2.0:1762166762.877204:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39084:x1847765440032128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166762.877214:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166762.877226:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b47d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78b5 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.877284:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0b484 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.877292:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0b484 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.877298:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0b484 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166762.877323:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 10485760 00000004:00200000:2.0:1762166762.877326:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166762.877338:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0b484 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.877355:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0000/0x2f180c4effb0b47d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78b5 expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.877368:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0b484 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78b5 expref: 12 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.877373:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.877375:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166762.877377:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1800, rc 0) 00000100:00100000:2.0:1762166762.877413:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39084:x1847765440032128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 210us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.877417:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2593 00000100:00100000:3.0:1762166762.878646:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.878692:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440032256 00000100:00100000:0.0:1762166762.878697:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440032256 00000100:00100000:0.0:1762166762.878729:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 939 00000100:00100000:0.0:1762166762.878734:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:2419:x1847765440032256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166762.878742:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166762.878753:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78bc expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166762.878768:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 10485760, mtime: 0x690887eb, atime: 0x0, ctime: 0x690887eb, blocks: 0x5000 00010000:00010000:0.0:1762166762.878779:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.878781:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.878786:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 13 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166762.878802:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 13 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166762.878809:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2200, rc 0) 00000100:00100000:0.0:1762166762.878842:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2419:x1847765440032256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 107us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166762.878849:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 939 00000100:00100000:0.0:1762166762.905124:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166762.905208:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440032384 00000100:00100000:3.0:1762166762.905224:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440032384 00000100:00100000:3.0:1762166762.905306:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 940 00000100:00100000:3.0:1762166762.905317:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2419:x1847765440032384:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166762.905507:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2419:x1847765440032384:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166762.905518:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 940 00000100:00100000:1.0:1762166762.906778:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166762.906840:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440032512 00000100:00100000:3.0:1762166762.906851:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440032512 00000100:00100000:3.0:1762166762.906913:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 941 00000100:00100000:3.0:1762166762.906927:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2418:x1847765440032512:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166762.907054:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2418:x1847765440032512:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 132us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166762.907062:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 941 00000100:00100000:1.0:1762166762.912319:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166762.912364:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166762.912393:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.912415:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440032640 00000100:00100000:2.0:1762166762.912427:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440032768 00000100:00100000:0.0:1762166762.912427:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440032640 00000100:00100000:2.0:1762166762.912433:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440032768 00000100:00100000:3.0:1762166762.912444:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440032896 00000100:00100000:3.0:1762166762.912449:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440032896 00000100:00100000:2.0:1762166762.912528:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 456 00000100:00100000:3.0:1762166762.912541:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 457 00000100:00100000:2.0:1762166762.912543:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fd0f52a9-204e-4869-b8da-3af938f6f960+15:2418:x1847765440032896:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166762.912552:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 458 00000100:00100000:3.0:1762166762.912556:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fd0f52a9-204e-4869-b8da-3af938f6f960+15:2419:x1847765440032768:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166762.912568:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+15:2419:x1847765440032640:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166762.912578:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.912588:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.912590:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.912594:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.912598:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.912607:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 7 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.912639:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.912639:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.912643:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.912648:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.912662:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.912662:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.912666:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166762.912672:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.912688:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.921253:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.921270:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.921279:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.921285:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166762.921289:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.921297:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.921314:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.921321:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0000/0x2f180c4effb0b492 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 5 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.921399:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fd0f52a9-204e-4869-b8da-3af938f6f960+17:2418:x1847765440032896:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 8858us (9000us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1762166762.921421:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 456 00010000:00010000:0.0:1762166762.927773:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.927788:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.927802:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.927807:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166762.927810:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.927815:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.927830:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.927836:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b499 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166762.927926:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+15:2419:x1847765440032640:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 15360us (15614us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1762166762.927934:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 458 00010000:00010000:3.0:1762166762.933828:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.933850:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.933859:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.933865:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166762.933895:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.933905:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.933935:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.933946:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477200/0x2f180c4effb0b4a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166762.934050:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2419:x1847765440032768:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 21492us (21678us total) trans 0 rc 4194304/4194304 00000100:00100000:3.0:1762166762.934062:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 457 00000100:00100000:1.0:1762166762.940291:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.940371:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440033024 00000100:00100000:2.0:1762166762.940396:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440033024 00000100:00100000:2.0:1762166762.940462:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 743 00000100:00100000:2.0:1762166762.940504:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39084:x1847765440033024:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:2.0:1762166762.940651:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39084:x1847765440033024:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 180us (374us total) trans 0 rc -61/-61 00000100:00100000:2.0:1762166762.940658:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 743 00000100:00100000:2.0:1762166762.945736:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166762.945796:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440033152 00000100:00100000:3.0:1762166762.945808:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440033152 00000100:00080000:0.0:1762166762.945900:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166762.945928:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 459 00000100:00100000:3.0:1762166762.945940:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fd0f52a9-204e-4869-b8da-3af938f6f960+6:2418:x1847765440033152:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166762.946012:0:23943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166762.946024:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.946043:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166762.946045:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166762.946052:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.946071:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166762.947258:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166762.947343:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440033280 00000100:00100000:0.0:1762166762.947359:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440033280 00000100:00100000:0.0:1762166762.947447:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 460 00000100:00100000:0.0:1762166762.947462:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2418:x1847765440033280:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166762.947532:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.947566:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.947568:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.947573:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.947586:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166762.948097:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166762.948153:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440033408 00000100:00100000:3.0:1762166762.948158:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440033408 00000100:00100000:3.0:1762166762.948191:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 461 00000100:00100000:3.0:1762166762.948197:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fd0f52a9-204e-4869-b8da-3af938f6f960+8:2418:x1847765440033408:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166762.948211:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.948218:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166762.948220:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166762.948223:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.948230:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166762.967610:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836657 is committed 00000001:00080000:3.0:1762166762.967625:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836655 is committed 00000001:00100000:3.0:1762166762.967630:0:24624:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd0f52a9-204e-4869-b8da-3af938f6f960 00000001:00100000:3.0:1762166762.967635:0:24624:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5f20b66-016a-4159-9d62-071c0da3ef0b 00000001:00080000:3.0:1762166762.967649:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836654 is committed 00000020:00000080:3.0:1762166762.967658:0:24624:0:(genops.c:904:class_export_put()) final put ffff945cf798d800/c5f20b66-016a-4159-9d62-071c0da3ef0b 00000020:00000080:0.0:1762166762.967685:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf798d800/c5f20b66-016a-4159-9d62-071c0da3ef0b for lustre-OST0000 00000020:00000080:0.0:1762166762.967749:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cf798a000 for lustre-OST0000 00000001:00080000:0.0:1762166762.973462:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836660 is committed 00002000:00010000:3.0:1762166762.973842:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:3.0:1762166762.973848:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb mtime from disk: 0 -> 1762166763 00002000:00010000:3.0:1762166762.973851:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb ctime from disk: 0 -> 1762166763 00002000:00010000:3.0:1762166762.973854:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb blocks from disk: 0 -> 20480 00010000:00010000:3.0:1762166762.973869:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.973900:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.973910:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.973917:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166762.973922:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.973931:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.973933:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.973951:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.973957:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.973968:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166762.973971:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.973983:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.973990:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.973992:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.973993:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 6 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.974009:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166762.974014:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.974017:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.974018:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 6 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.974027:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.974042:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.974052:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b4a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.974077:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166762.974086:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b4ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.974126:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2418:x1847765440033152:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 28184us (28396us total) trans 21474836659 rc 0/0 00000100:00100000:3.0:1762166762.974127:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2418:x1847765440033408:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 25925us (26028us total) trans 21474836658 rc 0/0 00000100:00100000:2.0:1762166762.974138:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 459 00000100:00100000:3.0:1762166762.974146:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 461 00000100:00100000:1.0:1762166762.974147:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2418:x1847765440033280:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 26685us (26889us total) trans 21474836660 rc 0/0 00000100:00100000:1.0:1762166762.974159:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 460 00000100:00100000:1.0:1762166762.986800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.986855:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440033664 00000100:00100000:2.0:1762166762.986864:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440033664 00000100:00100000:2.0:1762166762.986920:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2594 00000100:00100000:2.0:1762166762.986930:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39084:x1847765440033664:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166762.986995:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166762.987017:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0b484 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78b5 expref: 12 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.987032:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.987035:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166762.987170:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.987184:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.987191:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000001:00080000:2.0:1762166762.987223:0:12357:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968868 00000004:00010000:2.0:1762166762.987237:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000098754e1f reply state 00000000f3dc930f transno 4294968869 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.987258:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.987261:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.987264:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166762.987265:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166762.987328:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39084:x1847765440033664:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 400us (535us total) trans 4294968869 rc 0/0 00000100:00100000:2.0:1762166762.987333:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2594 00000020:00080000:2.0:1762166762.987337:0:12357:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166762.988419:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166762.988465:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440033792 00000100:00100000:3.0:1762166762.988471:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440033792 00000100:00100000:0.0:1762166762.988542:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 942 00000100:00100000:0.0:1762166762.988550:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+5:39084:x1847765440033792:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166762.988559:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166762.988570:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b4c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78c3 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166762.988586:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 10485760, mtime: 0x690887eb, atime: 0x0, ctime: 0x690887eb, blocks: 0x5000 00010000:00010000:0.0:1762166762.988597:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.988598:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166762.988603:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78c3 expref: 6 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.988613:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78c3 expref: 6 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166762.988635:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3600, rc 0) 00000100:00100000:0.0:1762166762.988682:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+6:39084:x1847765440033792:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 133us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166762.988689:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 942 00000100:00100000:0.0:1762166762.989531:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166762.989592:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440033920 00000100:00100000:1.0:1762166762.989597:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440033920 00002000:00010000:1.0:1762166762.989620:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/63 (10485760->18446744073709551615) 00002000:00100000:1.0:1762166762.989624:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5ef6d80 with x1847765440033920 ext(10485760->18446744073709551615) 00002000:00010000:1.0:1762166762.989632:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5ef6d80. 00000100:00100000:1.0:1762166762.989660:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 462 00000100:00100000:1.0:1762166762.989670:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+6:2419:x1847765440033920:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166762.989771:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:1.0:1762166762.989775:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb mtime from disk: 1762166763 -> 1762166763 00002000:00010000:1.0:1762166762.989778:0:16567:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166762.989780:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb ctime from disk: 1762166763 -> 1762166763 00002000:00010000:1.0:1762166762.989782:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb blocks from disk: 20480 -> 20480 00000100:00100000:1.0:1762166762.989814:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2419:x1847765440033920:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 146us (282us total) trans 21474836661 rc 0/0 00000100:00100000:1.0:1762166762.989822:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 462 00002000:00010000:1.0:1762166762.989833:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/63 (10485760->18446744073709551615) 00002000:00100000:1.0:1762166762.989836:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5ef6d80 with x1847765440033920 ext(10485760->18446744073709551615) 00002000:00010000:1.0:1762166762.989841:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5ef6d80. 00000100:00100000:1.0:1762166762.990689:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.990723:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440034176 00000100:00100000:2.0:1762166762.990727:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440034176 00000100:00100000:2.0:1762166762.990753:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2595 00000100:00100000:2.0:1762166762.990759:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39084:x1847765440034176:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166762.990810:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.990819:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.990826:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00010000:2.0:1762166762.990871:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007bee3bc4 reply state 00000000fef0d6db transno 4294968870 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.990889:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166762.990894:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.990896:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166762.990903:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166762.990957:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+16:39084:x1847765440034176:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 196us (267us total) trans 4294968870 rc 0/0 00000100:00100000:2.0:1762166762.990963:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2595 00000100:00100000:0.0:1762166762.991950:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166762.991995:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440034304 00000100:00100000:3.0:1762166762.992001:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440034304 00000100:00100000:3.0:1762166762.992037:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 943 00000100:00100000:3.0:1762166762.992050:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+13:39084:x1847765440034304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166762.992059:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166762.992070:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78ca expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.992090:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 14 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166762.992099:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166762.992101:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166762.992105:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4d1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ca expref: 14 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.992134:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 14 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166762.992148:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 14 pid: 9168 timeout: 482 lvb_type: 1 00000100:00100000:3.0:1762166762.992162:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446791680:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166762.992236:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166762.993091:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446791680:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166762.993112:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4d1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ca expref: 14 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166762.993126:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb600, rc 0) 00000100:00100000:3.0:1762166762.993158:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+14:39084:x1847765440034304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1109us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166762.993163:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 943 00000100:00100000:1.0:1762166762.993449:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.993591:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440034432 00000100:00100000:2.0:1762166762.993596:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440034432 00010000:00010000:2.0:1762166762.993617:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 14 pid: 9168 timeout: 482 lvb_type: 1 00000100:00100000:2.0:1762166762.993646:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 618 00000100:00100000:2.0:1762166762.993654:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+14:2418:x1847765440034432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166762.993665:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166762.993680:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 14 pid: 9168 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1762166762.993692:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 14 pid: 9168 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1762166762.993711:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b48b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78bc expref: 14 pid: 9168 timeout: 482 lvb_type: 1 00010000:00010000:2.0:1762166762.993721:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.993723:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166762.993727:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ca expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.993736:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ca expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.993771:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ca expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166762.993782:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446791808:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166762.993828:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166762.994864:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446791808:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166762.994875:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166762.994911:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2418:x1847765440034432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1258us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.994918:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 618 00000100:00100000:1.0:1762166762.995052:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166762.995420:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440034560 00000100:00100000:3.0:1762166762.995429:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440034560 00000100:00100000:3.0:1762166762.995469:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 944 00000100:00100000:3.0:1762166762.995493:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+13:2418:x1847765440034560:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166762.995649:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:2.0:1762166762.995654:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb mtime from disk: 1762166763 -> 1762166763 00002000:00010000:2.0:1762166762.995656:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb atime from disk: 0 -> 1762166762 00002000:00010000:2.0:1762166762.995659:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb ctime from disk: 1762166763 -> 1762166763 00002000:00010000:2.0:1762166762.995660:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb blocks from disk: 20480 -> 20480 00000100:00100000:2.0:1762166762.995691:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+14:2418:x1847765440034560:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 214us (650us total) trans 17179869348 rc 0/0 00000100:00100000:2.0:1762166762.995700:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 944 00000100:00100000:1.0:1762166762.996806:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.996875:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440034816 00000100:00100000:2.0:1762166762.996889:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440034816 00000100:00100000:2.0:1762166762.996933:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 744 00000100:00100000:2.0:1762166762.996944:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+16:39084:x1847765440034816:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166762.996993:0:6498:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b45a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78a7 expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.997042:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166762.997054:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.997078:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166762.997108:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 16 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166762.997120:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 16 pid: 12357 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1762166762.997133:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446791936:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166762.997180:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166762.998117:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446791936:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166762.998131:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166762.998244:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166762.998278:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440034944 00000100:00100000:2.0:1762166762.998283:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440034944 00010000:00010000:2.0:1762166762.998301:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 17 pid: 12357 timeout: 482 lvb_type: 0 00000100:00100000:2.0:1762166762.998330:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 619 00000100:00100000:2.0:1762166762.998339:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+17:2418:x1847765440034944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166762.998355:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166762.998362:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 17 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.998372:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 17 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.998385:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0e00/0x2f180c4effb0b476 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ae expref: 17 pid: 12357 timeout: 482 lvb_type: 0 00010000:00010000:2.0:1762166762.998398:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166762.998403:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166762.998410:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166762.998416:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166762.998436:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166762.998454:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166762.998462:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166762.998505:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0f52a9-204e-4869-b8da-3af938f6f960+16:2418:x1847765440034944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 140us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166762.998514:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 619 00000040:00080000:0.0:1762166762.998767:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].102, 88 off16472 00000004:00080000:0.0:1762166762.998773:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382147295033ns, next at 376358321105ns, rc = 0 00000040:00080000:0.0:1762166762.998805:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].106, 88 off16824 00000004:00080000:0.0:1762166762.998809:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382147331585ns, next at 376358357885ns, rc = 0 00000001:00080000:2.0:1762166762.999781:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968871 is committed 00000004:00080000:2.0:1762166762.999787:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00000004:00080000:2.0:1762166762.999801:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 93 committed 00010000:00010000:0.0:1762166762.999803:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999810:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999815:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999819:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166762.999823:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999840:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999848:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166762.999851:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166762.999854:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999859:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0b4bc lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999870:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999875:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999890:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166762.999892:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446792064:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166762.999898:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166762.999901:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999905:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166762.999917:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166762.999920:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:3.0:1762166762.999926:0:6498:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e66a6699 reply state 0000000054bd22a1 transno 4294968871 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166762.999926:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166762.999938:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166762.999944:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b4ca lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166762.999950:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166762.999969:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:3.0:1762166762.999972:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166762.999976:0:6498:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166762.999981:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:3.0:1762166762.999984:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:0.0:1762166762.999986:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446792192:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762166762.999992:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b45a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78a7 expref: 10 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166763.000023:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166763.000039:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446792064 00000100:00100000:1.0:1762166763.000045:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446792064 00000100:00100000:2.0:1762166763.000053:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446792192 00000100:00100000:2.0:1762166763.000059:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446792192 00010000:00080000:3.0:1762166763.000078:0:6498:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166763.000084:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:3.0:1762166763.000099:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+10:39084:x1847765440034816:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3154us (3290us total) trans 4294968871 rc 0/0 00000100:00100000:1.0:1762166763.000099:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446792064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166763.000104:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:3.0:1762166763.000116:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 744 00000100:00100000:2.0:1762166763.000121:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446792192:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762166763.000156:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166763.000162:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166763.000176:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00002000:00010000:1.0:1762166763.000180:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb size from disk: 10485760 -> 10485760 00010000:00010000:3.0:1762166763.000181:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad400 already unused, calling callback (ffffffffc18e2310) 00002000:00010000:1.0:1762166763.000186:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb mtime from disk: 1762166763 -> 1762166763 00010000:00010000:3.0:1762166763.000187:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00002000:00010000:1.0:1762166763.000190:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166763.000196:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb ctime from disk: 1762166763 -> 1762166763 00010000:00010000:3.0:1762166763.000199:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00002000:00010000:1.0:1762166763.000199:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3f:0x0] updating lvb blocks from disk: 20480 -> 20480 00002000:00010000:2.0:1762166763.000203:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb size from disk: 10485760 -> 10485760 00002000:00010000:2.0:1762166763.000210:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb mtime from disk: 1762166763 -> 1762166763 00002000:00010000:2.0:1762166763.000213:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb atime from disk: 1762166762 -> 1762166762 00002000:00010000:2.0:1762166763.000217:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb ctime from disk: 1762166763 -> 1762166763 00002000:00010000:2.0:1762166763.000220:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3c:0x0] updating lvb blocks from disk: 20480 -> 20480 00010000:00010000:3.0:1762166763.000226:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477ff00) 00000100:00100000:1.0:1762166763.000241:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446792064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (309us total) trans 21474836662 rc 0/0 00000100:00100000:1.0:1762166763.000247:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1762166763.000266:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446792192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (242us total) trans 17179869349 rc 0/0 00000100:00100000:0.0:1762166763.000272:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836657 gen 2 00000100:00100000:2.0:1762166763.000278:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000004:00080000:0.0:1762166763.000279:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b6d80, transno 21474836656 00010000:00010000:3.0:1762166763.000280:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166763.000287:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166763.000294:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b4d8 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00000004:00080000:0.0:1762166763.000299:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b7b80, transno 21474836657 00000100:00100000:0.0:1762166763.000309:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc4a28000 x1847765446792064/t21474836662(21474836662) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166778 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166763.000319:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28000/2, rc 0, transno 21474836662 00000100:00100000:0.0:1762166763.000322:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446792064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762166763.000357:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf7838700/2, rc 0, transno 17179869349 00000100:00100000:0.0:1762166763.000362:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446792192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166763.001018:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.001059:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440035072 00000100:00100000:2.0:1762166763.001063:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440035072 00000100:00100000:2.0:1762166763.001103:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2596 00000100:00100000:2.0:1762166763.001111:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+9:39084:x1847765440035072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166763.001121:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166763.001134:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0b4df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78d1 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.001169:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0b4df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78d1 expref: 10 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.001181:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0b4df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78d1 expref: 10 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.001196:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477f000) 00010000:00010000:2.0:1762166763.001200:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166763.001209:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cade00, rc 0) 00000100:00100000:2.0:1762166763.001244:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+10:39084:x1847765440035072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 134us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.001251:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2596 00000100:00100000:0.0:1762166763.002554:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.002601:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440035328 00000100:00100000:3.0:1762166763.002607:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440035328 00000100:00100000:3.0:1762166763.002639:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 745 00000100:00100000:3.0:1762166763.002647:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+10:39084:x1847765440035328:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166763.002776:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39084:x1847765440035328:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 129us (223us total) trans 4294968872 rc 0/0 00000100:00100000:3.0:1762166763.002783:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 745 00000100:00100000:1.0:1762166763.009382:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.009428:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440035456 00000100:00100000:2.0:1762166763.009436:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440035456 00000100:00100000:2.0:1762166763.009504:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2597 00000100:00100000:2.0:1762166763.009514:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+11:39086:x1847765440035456:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:2.0:1762166763.009533:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166763.009555:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b4e6 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78d8 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.009613:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009626:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009637:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009649:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009656:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009662:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009728:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009750:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009757:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:2.0:1762166763.009792:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 10485760 00000004:00200000:2.0:1762166763.009796:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166763.009812:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009823:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009831:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009837:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009843:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009848:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166763.009852:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009859:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009869:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166763.009872:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166763.009888:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009901:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b4ed lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009915:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009934:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009940:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009945:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166763.009948:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009953:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009961:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945bc477f400) 00010000:00010000:2.0:1762166763.009964:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166763.009968:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.009973:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b4f4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166763.010000:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b4e6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78d8 expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.010014:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b4fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78d8 expref: 12 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.010032:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477f000) 00010000:00010000:2.0:1762166763.010035:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166763.010037:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac000, rc 0) 00000100:00100000:2.0:1762166763.010091:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39086:x1847765440035456:12345-192.168.204.38@tcp:101:stat.0 Request processed in 578us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.010098:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2597 00000100:00100000:1.0:1762166763.018216:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.018288:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440035584 00000100:00100000:3.0:1762166763.018298:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440035584 00000100:00100000:3.0:1762166763.018341:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 746 00000100:00100000:3.0:1762166763.018349:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39087:x1847765440035584:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:3.0:1762166763.018516:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39087:x1847765440035584:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 168us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.018523:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 746 00000100:00100000:0.0:1762166763.027534:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.027593:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440035712 00000100:00100000:2.0:1762166763.027602:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440035712 00000100:00100000:2.0:1762166763.027663:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 747 00000100:00100000:2.0:1762166763.027674:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39088:x1847765440035712:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:2.0:1762166763.027816:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd0f52a9-204e-4869-b8da-3af938f6f960+12:39088:x1847765440035712:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 144us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.027825:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 747 00010000:00010000:0.0:1762166763.282611:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166763.282626:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446792320:0@lo:400:kworker.0 00000100:00100000:0.0:1762166763.282671:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765446792704:0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.282697:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166763.282721:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166763.282725:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446792576:0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.282750:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446792832:0@lo:400:kworker.0 00000100:00100000:0.0:1762166763.282756:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446793216:0@lo:400:kworker.0 00000100:00100000:3.0:1762166763.282767:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166763.282795:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446793088:0@lo:400:kworker.0 00000100:00100000:0.0:1762166763.282796:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166763.282805:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166763.282813:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1847765446792448:0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.282839:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446793344:0@lo:400:kworker.0 00000100:00100000:3.0:1762166763.282841:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166763.282845:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446792320 00000100:00100000:2.0:1762166763.282853:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166763.282853:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446792320 00000100:00100000:3.0:1762166763.282866:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446793600:0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.282890:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446792960:0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.282897:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166763.282915:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166763.282916:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446792576 00000100:00100000:3.0:1762166763.282920:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446792576 00000100:00100000:0.0:1762166763.282925:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1762166763.282938:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765446792320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.282943:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446793472:0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.282954:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446792832 00000100:00100000:3.0:1762166763.282959:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1762166763.282960:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446792832 00000100:00100000:2.0:1762166763.282968:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166763.282969:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446792576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.282987:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1762166763.282998:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446792832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.283015:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446793088 00000100:00100000:3.0:1762166763.283019:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446792576:12345-0@lo:400:kworker.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.283019:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446793088 00000100:00100000:0.0:1762166763.283020:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765446792320:12345-0@lo:400:kworker.0 Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.283033:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1762166763.283038:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446792832:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.283045:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446792960 00000100:00100000:2.0:1762166763.283049:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446792960 00000100:00100000:1.0:1762166763.283050:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1762166763.283051:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1762166763.283056:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446792704 00000100:00100000:3.0:1762166763.283060:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446792704 00000100:00100000:2.0:1762166763.283073:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1762166763.283082:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446793216 00000100:00100000:2.0:1762166763.283082:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446793088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166763.283085:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446793216 00000100:00100000:1.0:1762166763.283097:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446792448 00000100:00100000:0.0:1762166763.283104:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1762166763.283107:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446793344 00000100:00100000:1.0:1762166763.283107:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446792448 00000100:00100000:3.0:1762166763.283113:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446793344 00000100:00100000:0.0:1762166763.283117:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446792960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.283131:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446793472 00000100:00100000:1.0:1762166763.283135:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446793472 00000100:00100000:3.0:1762166763.283141:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1762166763.283141:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446793088:12345-0@lo:400:kworker.0 Request processed in 61us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.283149:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1762166763.283151:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765446792704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.283160:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1762166763.283168:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446792960:12345-0@lo:400:kworker.0 Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166763.283170:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446793216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.283178:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1762166763.283182:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1762166763.283191:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765446792704:12345-0@lo:400:kworker.0 Request processed in 42us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.283191:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1847765446792448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166763.283198:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1762166763.283209:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446793216:12345-0@lo:400:kworker.0 Request processed in 40us (414us total) trans 0 rc 0/0 00000100:00080000:0.0:1762166763.283209:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166763.283217:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:0.0:1762166763.283217:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166763.283229:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1762166763.283229:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1847765446792448:12345-0@lo:400:kworker.0 Request processed in 40us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.283236:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1762166763.283239:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446793344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.283242:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1762166763.283253:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1847765446792448:0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.283254:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446793472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166763.283272:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836655 gen 2 00000004:00080000:0.0:1762166763.283278:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836653 committed transno 21474836655 00000100:00100000:3.0:1762166763.283282:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446793344:12345-0@lo:400:kworker.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.283289:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1762166763.283294:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446793472:12345-0@lo:400:kworker.0 Request processed in 42us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.283297:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166763.283300:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6c000, transno 21474836655 00000100:00100000:1.0:1762166763.283304:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1762166763.283317:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446792960:0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.283319:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446793600 00000100:00100000:1.0:1762166763.283323:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446793600 00000100:00100000:0.0:1762166763.283337:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446793472:0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.283343:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968851 gen 2 00000004:00080000:2.0:1762166763.283348:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968850 committed transno 4294968851 00000100:00100000:1.0:1762166763.283362:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000004:00080000:2.0:1762166763.283366:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968851 committed transno 4294968851 00000100:00100000:1.0:1762166763.283377:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446793600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.283385:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446792576:0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.283398:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869341 gen 2 00000004:00080000:2.0:1762166763.283401:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869340 committed transno 17179869341 00000100:00100000:3.0:1762166763.283403:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446793216:0@lo:400:kworker.0 00000100:00100000:1.0:1762166763.283408:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446793600:12345-0@lo:400:kworker.0 Request processed in 32us (114us total) trans 0 rc 0/0 00000004:00080000:2.0:1762166763.283411:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe31880, transno 17179869341 00000100:00100000:1.0:1762166763.283415:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1762166763.283417:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765446792704:0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.283425:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446793088:0@lo:400:kworker.0 00000100:00100000:2.0:1762166763.283438:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446793600:0@lo:400:kworker.0 00000100:00080000:1.0:1762166763.283441:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1762166763.283450:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967413 gen 2 00000004:00080000:3.0:1762166763.283455:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967413 committed transno 4294967413 00000020:00080000:3.0:1762166763.283460:0:3633:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945d011c7a80 refcount 2 committed 0 result 0 batchid 42 00000020:00080000:3.0:1762166763.283464:0:3633:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945d011c7480 00000020:00080000:3.0:1762166763.283467:0:3633:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].7 00000020:00080000:3.0:1762166763.283470:0:3633:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bcc0acc00 00000020:00080000:3.0:1762166763.283473:0:3633:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].19 00000020:00080000:0.0:1762166763.283512:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 42 committed batchid 41 00000100:00100000:3.0:1762166763.283517:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446792832:0@lo:400:kworker.0 00000100:00100000:3.0:1762166763.283532:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446793344:0@lo:400:kworker.0 00000100:00100000:3.0:1762166763.283539:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446792320:0@lo:400:kworker.0 00000020:00080000:0.0:1762166763.283548:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 41 00000100:00100000:1.0:1762166763.290662:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166763.290701:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.290743:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440035840 00000100:00100000:1.0:1762166763.290751:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.290754:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440035840 00000100:00100000:2.0:1762166763.290810:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440035968 00000100:00100000:2.0:1762166763.290815:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440035968 00000100:00100000:3.0:1762166763.290828:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440036096 00000100:00100000:3.0:1762166763.290834:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440036096 00000100:00100000:0.0:1762166763.290839:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 276 00000100:00100000:2.0:1762166763.290850:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 277 00000100:00100000:0.0:1762166763.290856:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:918fd9a9-e029-468d-bf95-286cac877d5e+11:2418:x1847765440035840:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166763.290865:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918fd9a9-e029-468d-bf95-286cac877d5e+11:2418:x1847765440035968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166763.290882:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 278 00010000:00010000:0.0:1762166763.290890:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166763.290896:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918fd9a9-e029-468d-bf95-286cac877d5e+11:2417:x1847765440036096:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166763.290896:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166763.290905:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166763.290913:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bcc9e2800/0x2f180c4effb0b238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77ab expref: 11 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.290921:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bcc9e2e00/0x2f180c4effb0b23f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77dc expref: 11 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.290924:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bcc9e2c00/0x2f180c4effb0b246 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77e3 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166763.290935:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166763.290944:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166763.290949:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166763.291110:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918fd9a9-e029-468d-bf95-286cac877d5e+8:2418:x1847765440035968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 248us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.291111:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918fd9a9-e029-468d-bf95-286cac877d5e+8:2417:x1847765440036096:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 217us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166763.291111:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:918fd9a9-e029-468d-bf95-286cac877d5e+8:2418:x1847765440035840:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 256us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.291131:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 277 00000100:00100000:3.0:1762166763.291140:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 278 00000100:00100000:0.0:1762166763.291148:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 276 00000100:00100000:1.0:1762166763.296885:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.296939:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440036480 00000100:00100000:3.0:1762166763.296949:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440036480 00000100:00100000:3.0:1762166763.297008:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 947 00000100:00100000:3.0:1762166763.297019:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+14:2415:x1847765440036480:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:3.0:1762166763.297061:0:9165:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0b262 00000020:00010000:3.0:1762166763.297068:0:9165:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945cc7d3d800: total 0 00000100:00080000:3.0:1762166763.297072:0:9165:0:(import.c:65:import_set_state_nolock()) ffff945cc7d39800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1762166763.297131:0:9165:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869349 00000020:00010000:1.0:1762166763.297244:0:10256:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945cc7d3d800: total 0 00010000:00010000:1.0:1762166763.297249:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166763.297280:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+12:2415:x1847765440036480:12345-192.168.204.38@tcp:9:umount.0 Request processed in 261us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.297290:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 947 00010000:00010000:1.0:1762166763.297307:0:10256:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945cc7d3d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1762166763.297355:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0b4d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ca expref: 11 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166763.297393:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa2b600/0x2f180c4effb0b2bd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7830 expref: 10 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166763.297407:0:10256:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945cc7d3d800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1762166763.297420:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166763.297422:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166763.297424:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166763.311289:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.311378:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440036736 00000100:00100000:3.0:1762166763.311396:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440036736 00000100:00100000:3.0:1762166763.311470:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 948 00000100:00100000:3.0:1762166763.311521:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2415:x1847765440036736:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:3.0:1762166763.311562:0:9165:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0b25b 00000020:00010000:3.0:1762166763.311571:0:9165:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945bc81f6000: total 0 00000100:00080000:3.0:1762166763.311577:0:9165:0:(import.c:65:import_set_state_nolock()) ffff945bc81f4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1762166763.311642:0:9165:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836662 00000020:00010000:0.0:1762166763.311648:0:6482:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945bc81f6000: total 0 00010000:00010000:0.0:1762166763.311718:0:6482:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945bc81f6000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1762166763.311800:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b4c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78c3 expref: 5 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166763.311827:0:6482:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945bc81f6000, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1762166763.311839:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+4:2415:x1847765440036736:12345-192.168.204.38@tcp:9:umount.0 Request processed in 320us (557us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166763.311842:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166763.311846:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166763.311850:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166763.311854:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 948 00000100:00100000:0.0:1762166763.315414:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166763.315538:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440037376 00000100:00100000:1.0:1762166763.315560:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440037376 00000100:00100000:1.0:1762166763.315652:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2598 00000100:00100000:1.0:1762166763.315665:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+12:2415:x1847765440037376:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:1.0:1762166763.315702:0:7432:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0b254 00000020:00010000:1.0:1762166763.315727:0:7432:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945cf4170800: total 0 00000100:00080000:1.0:1762166763.315732:0:7432:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1762166763.315760:0:7432:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968872 00000020:00010000:2.0:1762166763.315811:0:6483:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945cf4170800: total 0 00010000:00010000:2.0:1762166763.315912:0:6483:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945cf4170800, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1762166763.315959:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477f000) 00010000:00010000:2.0:1762166763.315963:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166763.315974:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b4fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78d8 expref: 11 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166763.315976:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+11:2415:x1847765440037376:12345-192.168.204.38@tcp:39:umount.0 Request processed in 310us (574us total) trans 4294968873 rc 0/0 00000100:00100000:1.0:1762166763.316007:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2598 00010000:00010000:2.0:1762166763.316030:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166763.316036:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1762166763.316045:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b342 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7845 expref: 9 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.316066:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc477f000) 00010000:00010000:2.0:1762166763.316069:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166763.316074:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0b4df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78d1 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.316095:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166763.316098:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166763.316102:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1e00/0x2f180c4effb0b38f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7861 expref: 7 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.316122:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166763.316138:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166763.316153:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b326 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b783e expref: 6 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.316174:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945cf39a3000) 00010000:00010000:2.0:1762166763.316176:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166763.316180:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b28c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b781b expref: 5 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166763.316195:0:6483:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945cf4170800, canceled 6 locks, left on hash table 0. 00010000:00010000:2.0:1762166763.316210:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166763.316212:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166763.316214:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166763.320861:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.320954:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440037760 00000100:00100000:2.0:1762166763.320971:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440037760 00000100:00100000:2.0:1762166763.321046:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2599 00000100:00100000:2.0:1762166763.321056:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+7:2415:x1847765440037760:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:2.0:1762166763.321098:0:7432:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0b24d 00000020:00010000:2.0:1762166763.321108:0:7432:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945bcc02f800: total 0 00000100:00080000:2.0:1762166763.321112:0:7432:0:(import.c:65:import_set_state_nolock()) ffff945bcc02b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1762166763.321140:0:7432:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967413 00000020:00010000:0.0:1762166763.321163:0:7420:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945bcc02f800: total 0 00010000:00010000:0.0:1762166763.321234:0:7420:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945bcc02f800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1762166763.321278:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff945cd1ddde00) 00010000:00010000:0.0:1762166763.321283:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166763.321296:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0b35e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7853 expref: 6 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166763.321330:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff945cf39a3800) 00010000:00010000:0.0:1762166763.321333:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1762166763.321338:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b29a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7822 expref: 5 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166763.321354:0:7420:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945bcc02f800, canceled 2 locks, left on hash table 0. 00000100:00100000:2.0:1762166763.321368:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd0f52a9-204e-4869-b8da-3af938f6f960+4:2415:x1847765440037760:12345-192.168.204.38@tcp:39:umount.0 Request processed in 308us (511us total) trans 4294967414 rc 0/0 00010000:00010000:0.0:1762166763.321374:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166763.321379:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166763.321383:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166763.321389:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2599 00000100:00100000:0.0:1762166763.331067:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.331147:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440038016 00000100:00100000:3.0:1762166763.331158:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440038016 00000100:00100000:3.0:1762166763.331214:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 578 00000100:00100000:3.0:1762166763.331227:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:918fd9a9-e029-468d-bf95-286cac877d5e+6:2415:x1847765440038016:12345-192.168.204.38@tcp:251:umount.0 00000020:00000080:3.0:1762166763.331263:0:6487:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0b22a 00000020:00010000:3.0:1762166763.331271:0:6487:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945bc4b71800: total 0 00000100:00080000:3.0:1762166763.331276:0:6487:0:(import.c:65:import_set_state_nolock()) ffff945bc4b77000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1762166763.331305:0:10257:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945bc4b71800: total 0 00010000:00010000:0.0:1762166763.331356:0:10257:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945bc4b71800, canceled 0 locks, left on hash table 1. 00000100:00100000:3.0:1762166763.331358:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:918fd9a9-e029-468d-bf95-286cac877d5e+3:2415:x1847765440038016:12345-192.168.204.38@tcp:251:umount.0 Request processed in 133us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.331369:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 578 00010000:00010000:0.0:1762166763.331385:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bcc9e3000/0x2f180c4effb0b231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b77a4 expref: 2 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166763.331399:0:10257:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945bc4b71800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1762166763.331410:0:10257:0:(genops.c:904:class_export_put()) final put ffff945bc4b71800/918fd9a9-e029-468d-bf95-286cac877d5e 00010000:00010000:0.0:1762166763.331423:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166763.331425:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166763.331427:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1762166763.331447:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc4b71800/918fd9a9-e029-468d-bf95-286cac877d5e for MGS 00000020:00000080:3.0:1762166763.331518:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc4b77000 for MGS 00000100:00100000:1.0:1762166763.397671:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.397729:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440038144 00000100:00100000:3.0:1762166763.397740:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440038144 00000100:00100000:3.0:1762166763.397782:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 579 00000100:00100000:3.0:1762166763.397791:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2415:x1847765440038144:12345-192.168.204.38@tcp:250:mount.lustre.0 00010000:00080000:3.0:1762166763.397818:0:6487:0:(ldlm_lib.c:1428:target_handle_connect()) MGS: connection from cc359222-7391-43f5-989b-bf5867ae8fd6@192.168.204.38@tcp t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:3.0:1762166763.397843:0:6487:0:(genops.c:1402:class_connect()) connect: client cc359222-7391-43f5-989b-bf5867ae8fd6, cookie 0x2f180c4effb0b502 00000020:01000000:3.0:1762166763.397850:0:6487:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc7b09c00 00000100:00080000:3.0:1762166763.397904:0:6487:0:(import.c:65:import_set_state_nolock()) ffff945bc4bb5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166763.397973:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+4:2415:x1847765440038144:12345-192.168.204.38@tcp:250:mount.lustre.0 Request processed in 181us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.397981:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 579 00000100:00100000:1.0:1762166763.399225:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.399309:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440038272 00000100:00100000:3.0:1762166763.399315:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440038272 00000100:00100000:3.0:1762166763.399352:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 580 00000100:00100000:3.0:1762166763.399361:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+4:39120:x1847765440038272:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166763.399385:0:6487:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166763.399401:0:6487:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945cc29cba00/0x2f180c4effb0b509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78ed expref: -99 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.399425:0:6487:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945cc29cba00/0x2f180c4effb0b509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ed expref: 5 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.399436:0:6487:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945cc29cba00/0x2f180c4effb0b509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ed expref: 5 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.399446:0:6487:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cba00, rc 0) 00000100:00100000:3.0:1762166763.399512:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+5:39120:x1847765440038272:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 152us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.399520:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 580 00000100:00100000:0.0:1762166763.400650:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.400710:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440038400 00000100:00100000:3.0:1762166763.400720:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440038400 00000100:00100000:3.0:1762166763.400770:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 581 00000100:00100000:3.0:1762166763.400782:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+5:39120:x1847765440038400:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1762166763.400926:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+5:39120:x1847765440038400:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 147us (283us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166763.400935:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 581 00000100:00100000:1.0:1762166763.402109:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.402171:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440038528 00000100:00100000:3.0:1762166763.402179:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440038528 00000100:00100000:3.0:1762166763.402230:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 582 00000100:00100000:3.0:1762166763.402240:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+5:39120:x1847765440038528:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166763.402256:0:6487:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166763.402271:0:6487:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945cc29cb800/0x2f180c4effb0b510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b78f4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.402308:0:6487:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945cc29cb800/0x2f180c4effb0b510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78f4 expref: 6 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.402317:0:6487:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945cc29cb800/0x2f180c4effb0b510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78f4 expref: 6 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.402326:0:6487:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb800, rc 0) 00000100:00100000:3.0:1762166763.402372:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+6:39120:x1847765440038528:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 134us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.402379:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 582 00000100:00100000:1.0:1762166763.403317:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.403359:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440038656 00000100:00100000:3.0:1762166763.403366:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440038656 00000100:00100000:3.0:1762166763.403400:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 583 00000100:00100000:3.0:1762166763.403409:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+6:39120:x1847765440038656:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1762166763.403549:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39120:x1847765440038656:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 141us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.403569:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 583 00000100:00100000:0.0:1762166763.404249:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.404301:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440038784 00000100:00100000:3.0:1762166763.404306:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440038784 00000100:00100000:3.0:1762166763.404337:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 584 00000100:00100000:3.0:1762166763.404346:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39120:x1847765440038784:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1762166763.404430:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39120:x1847765440038784:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 85us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.404438:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 584 00000100:00100000:1.0:1762166763.405576:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.405619:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440038912 00000100:00100000:3.0:1762166763.405631:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440038912 00000100:00100000:3.0:1762166763.405697:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 585 00000100:00100000:3.0:1762166763.405703:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39138:x1847765440038912:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166763.405759:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39138:x1847765440038912:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 56us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.405764:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 585 00000100:00100000:1.0:1762166763.414710:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.414766:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440039040 00000100:00100000:3.0:1762166763.414776:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440039040 00000100:00100000:3.0:1762166763.414827:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 586 00000100:00100000:3.0:1762166763.414836:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39138:x1847765440039040:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166763.414988:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39138:x1847765440039040:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 152us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.414996:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 586 00000100:00100000:0.0:1762166763.415866:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166763.415924:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440039168 00000100:00100000:1.0:1762166763.415929:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440039168 00000100:00100000:1.0:1762166763.415961:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 587 00000100:00100000:1.0:1762166763.415970:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39138:x1847765440039168:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1762166763.416046:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39138:x1847765440039168:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166763.416053:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 587 00000100:00100000:1.0:1762166763.420710:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.420761:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440039296 00000100:00100000:3.0:1762166763.420771:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440039296 00000100:00100000:3.0:1762166763.420820:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 588 00000100:00100000:3.0:1762166763.420830:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39120:x1847765440039296:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166763.420846:0:6487:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166763.420861:0:6487:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945cc29ca800/0x2f180c4effb0b517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7925 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.420901:0:6487:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945cc29ca800/0x2f180c4effb0b517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7925 expref: 8 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.420910:0:6487:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945cc29ca800/0x2f180c4effb0b517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7925 expref: 8 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.420929:0:6487:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca800, rc 0) 00000100:00100000:3.0:1762166763.420973:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39120:x1847765440039296:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 146us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.420978:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 588 00000100:00100000:0.0:1762166763.422327:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.422375:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440039424 00000100:00100000:3.0:1762166763.422381:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440039424 00000100:00100000:3.0:1762166763.422421:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 589 00000100:00100000:3.0:1762166763.422430:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39120:x1847765440039424:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:3.0:1762166763.422451:0:6487:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1762166763.422472:0:6487:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1762166763.422502:0:6487:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1762166763.422506:0:6487:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1762166763.422509:0:6487:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1762166763.422511:0:6487:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 13 00000100:00100000:3.0:1762166763.423303:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39120:x1847765440039424:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 874us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.423310:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 589 00000100:00100000:1.0:1762166763.425035:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.425073:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440039552 00000100:00100000:3.0:1762166763.425078:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440039552 00000100:00100000:3.0:1762166763.425109:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 590 00000100:00100000:3.0:1762166763.425117:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39120:x1847765440039552:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166763.425129:0:6487:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166763.425143:0:6487:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945cc29ca000/0x2f180c4effb0b51e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b792c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.425165:0:6487:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945cc29ca000/0x2f180c4effb0b51e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b792c expref: 9 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.425179:0:6487:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945cc29ca000/0x2f180c4effb0b51e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b792c expref: 9 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166763.425185:0:6487:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca000, rc 0) 00000100:00100000:3.0:1762166763.425218:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39120:x1847765440039552:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 101us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.425224:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 590 00000100:00100000:0.0:1762166763.425902:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.425936:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440039680 00000100:00100000:3.0:1762166763.425940:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440039680 00000100:00100000:3.0:1762166763.425960:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 591 00000100:00100000:3.0:1762166763.425965:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39120:x1847765440039680:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1762166763.426059:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39120:x1847765440039680:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 94us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.426064:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 591 00000100:00100000:0.0:1762166763.426690:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.426722:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440039808 00000100:00100000:3.0:1762166763.426726:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440039808 00000100:00100000:3.0:1762166763.426748:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 592 00000100:00100000:3.0:1762166763.426753:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39120:x1847765440039808:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1762166763.426816:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39120:x1847765440039808:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.426821:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 592 00000100:00100000:1.0:1762166763.427967:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.428026:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440039936 00000100:00100000:3.0:1762166763.428032:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440039936 00000100:00100000:3.0:1762166763.428110:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 593 00000100:00100000:3.0:1762166763.428122:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39144:x1847765440039936:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166763.428216:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39144:x1847765440039936:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.428225:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 593 00000100:00100000:0.0:1762166763.429095:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.429127:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440040064 00000100:00100000:3.0:1762166763.429131:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440040064 00000100:00100000:3.0:1762166763.429152:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 594 00000100:00100000:3.0:1762166763.429156:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39144:x1847765440040064:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762166763.429205:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39144:x1847765440040064:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 49us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.429210:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 594 00000100:00100000:0.0:1762166763.430533:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.430596:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440040192 00000100:00100000:2.0:1762166763.430602:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440040192 00000100:00100000:2.0:1762166763.430637:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2600 00000100:00100000:0.0:1762166763.430637:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.430646:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2415:x1847765440040192:12345-192.168.204.38@tcp:38:mount.lustre.0 00000100:00100000:3.0:1762166763.430669:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440040448 00010000:00080000:2.0:1762166763.430673:0:7432:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp t0 exp 0000000000000000 cur 382 last 0 00000100:00100000:3.0:1762166763.430676:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440040448 00000020:00000080:2.0:1762166763.430709:0:7432:0:(genops.c:1402:class_connect()) connect: client e1e11365-ba0b-405b-99c9-a704373217f2, cookie 0x2f180c4effb0b525 00000100:00100000:3.0:1762166763.430712:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2601 00000100:00100000:3.0:1762166763.430720:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2415:x1847765440040448:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:3.0:1762166763.430738:0:6495:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0001: connection from e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp t0 exp 0000000000000000 cur 382 last 0 00000004:00100000:2.0:1762166763.430739:0:7432:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1762166763.430774:0:6495:0:(genops.c:1402:class_connect()) connect: client e1e11365-ba0b-405b-99c9-a704373217f2, cookie 0x2f180c4effb0b52c 00000004:00100000:3.0:1762166763.430789:0:6495:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000020:01000000:2.0:1762166763.430790:0:7432:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc9c25900 00000100:00080000:2.0:1762166763.430821:0:7432:0:(import.c:65:import_set_state_nolock()) ffff945bc81f5800 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1762166763.430834:0:6495:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf1f8fc00 00000100:00080000:3.0:1762166763.430859:0:6495:0:(import.c:65:import_set_state_nolock()) ffff945cf3d1e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1762166763.430884:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+6:2415:x1847765440040192:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 225us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.430893:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2600 00000100:00100000:3.0:1762166763.430907:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:2415:x1847765440040448:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 184us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.430915:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2601 00000100:00100000:0.0:1762166763.434991:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166763.435014:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166763.435035:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.435056:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440040704 00000100:00100000:3.0:1762166763.435065:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440040704 00000100:00100000:2.0:1762166763.435074:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440040576 00000100:00100000:2.0:1762166763.435080:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440040576 00000100:00100000:1.0:1762166763.435090:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440040320 00000100:00100000:1.0:1762166763.435097:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440040320 00000100:00080000:0.0:1762166763.435128:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1762166763.435133:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166763.435146:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2602 00000100:00100000:3.0:1762166763.435155:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2603 00000100:00100000:2.0:1762166763.435159:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+6:0:x1847765440040576:12345-192.168.204.38@tcp:41:mount.lustre.0 00000100:00100000:1.0:1762166763.435173:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2604 00000100:00100000:3.0:1762166763.435179:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:0:x1847765440040320:12345-192.168.204.38@tcp:41:mount.lustre.0 00000100:00100000:1.0:1762166763.435188:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+7:39120:x1847765440040704:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1762166763.435190:0:7432:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446252544 avail 1300013056 00000004:00000024:3.0:1762166763.435203:0:6495:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446002688 avail 1299763200 00000004:00000024:1.0:1762166763.435214:0:6496:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1762166763.435246:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+6:0:x1847765440040576:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166763.435253:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+7:39120:x1847765440040704:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.435261:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2602 00000100:00100000:3.0:1762166763.435262:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:0:x1847765440040320:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 85us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166763.435272:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2604 00000100:00100000:3.0:1762166763.435279:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2603 00000100:00100000:1.0:1762166763.436011:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.436049:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440040832 00000100:00100000:3.0:1762166763.436054:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440040832 00000100:00100000:3.0:1762166763.436083:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2605 00000100:00100000:3.0:1762166763.436094:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:39120:x1847765440040832:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1762166763.436137:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:39120:x1847765440040832:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.436143:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2605 00000100:00100000:0.0:1762166763.436965:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.437041:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440041216 00000100:00100000:2.0:1762166763.437045:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440041216 00000100:00100000:2.0:1762166763.437069:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1762166763.437074:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:e1e11365-ba0b-405b-99c9-a704373217f2+6:39120:x1847765440041216:12345-192.168.204.38@tcp:900:mount.lustre.0 00000100:00100000:2.0:1762166763.437111:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:e1e11365-ba0b-405b-99c9-a704373217f2+6:39120:x1847765440041216:12345-192.168.204.38@tcp:900:mount.lustre.0 Request processed in 36us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.437118:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:0.0:1762166763.437798:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166763.437846:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440041344 00000100:00100000:2.0:1762166763.437850:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440041344 00000100:00100000:2.0:1762166763.437894:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 748 00000100:00100000:2.0:1762166763.437900:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:39120:x1847765440041344:12345-192.168.204.38@tcp:33:mount.lustre.0 00000004:00200000:2.0:1762166763.437960:0:6498:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1762166763.438008:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:39120:x1847765440041344:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 108us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166763.438016:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 748 00000100:00100000:1.0:1762166763.453087:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166763.453160:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166763.453192:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440040960 00000100:00100000:3.0:1762166763.453210:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440040960 00000100:00100000:3.0:1762166763.453262:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440041088 00000100:00100000:3.0:1762166763.453266:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440041088 00000100:00100000:3.0:1762166763.453308:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 949 00000100:00100000:0.0:1762166763.453320:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 950 00000100:00100000:3.0:1762166763.453322:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2415:x1847765440040960:12345-192.168.204.38@tcp:8:mount.lustre.0 00000100:00100000:0.0:1762166763.453333:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2415:x1847765440041088:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1762166763.453370:0:28874:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp t0 exp 0000000000000000 cur 382 last 0 00010000:00080000:3.0:1762166763.453371:0:9165:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:3.0:1762166763.453409:0:9165:0:(genops.c:1402:class_connect()) connect: client e1e11365-ba0b-405b-99c9-a704373217f2, cookie 0x2f180c4effb0b533 00000020:00000080:0.0:1762166763.453415:0:28874:0:(genops.c:1402:class_connect()) connect: client e1e11365-ba0b-405b-99c9-a704373217f2, cookie 0x2f180c4effb0b53a 00002000:00100000:3.0:1762166763.453426:0:9165:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli e1e11365-ba0b-405b-99c9-a704373217f2/ffff945bc4b77000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1762166763.453427:0:28874:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli e1e11365-ba0b-405b-99c9-a704373217f2/ffff945bcc02d800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1762166763.453445:0:28874:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:3.0:1762166763.453446:0:9165:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:01000000:3.0:1762166763.453567:0:9165:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945bc49ab600 00000020:01000000:0.0:1762166763.453567:0:28874:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc9241100 00002000:00080000:0.0:1762166763.453584:0:28874:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:3.0:1762166763.453585:0:9165:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1762166763.453632:0:9165:0:(import.c:65:import_set_state_nolock()) ffff945bc4b70000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1762166763.453632:0:28874:0:(import.c:65:import_set_state_nolock()) ffff945bcc028000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166763.453724:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+6:2415:x1847765440040960:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 401us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166763.453725:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2415:x1847765440041088:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 388us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166763.453738:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 949 00000100:00100000:0.0:1762166763.453748:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 950 00000100:00100000:0.0:1762166764.145090:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166764.145139:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440041472 00000100:00100000:3.0:1762166764.145150:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440041472 00000100:00100000:3.0:1762166764.145213:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2606 00000100:00100000:3.0:1762166764.145224:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:39200:x1847765440041472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166764.145244:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166764.145262:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b795d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.145313:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.145323:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.145332:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166764.145368:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1762166764.145371:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166764.145395:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.145413:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.145425:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 7 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.145439:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166764.145441:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166764.145444:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb600, rc 0) 00000100:00100000:3.0:1762166764.145527:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:39200:x1847765440041472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 306us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166764.145533:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2606 00000100:00100000:3.0:1762166764.146705:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166764.146738:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440041600 00000100:00100000:0.0:1762166764.146743:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440041600 00000100:00100000:0.0:1762166764.146780:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2607 00000100:00100000:0.0:1762166764.146793:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:39200:x1847765440041600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166764.146804:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166764.146815:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b54f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7964 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.146851:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.146872:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.146878:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.146888:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.146901:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.146906:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.146962:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b564 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.146967:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b564 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.146971:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b564 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166764.147016:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166764.147019:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1762166764.147028:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b564 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147044:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147048:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147053:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147056:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166764.147059:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147062:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147074:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166764.147077:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166764.147080:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147084:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b556 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147090:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147093:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147096:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147099:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166764.147101:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147104:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147107:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1ec0156 (ffff945bc4034200) 00010000:00010000:0.0:1762166764.147109:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166764.147110:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147113:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b55d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1ec0156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.147129:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b54f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7964 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.147142:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b564 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7964 expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.147147:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff945bc4034e00) 00010000:00010000:0.0:1762166764.147149:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1762166764.147150:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3000, rc 0) 00000100:00100000:0.0:1762166764.147182:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:39200:x1847765440041600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 394us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166764.147189:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2607 00000100:00100000:0.0:1762166764.147987:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166764.148030:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440041728 00000100:00100000:2.0:1762166764.148037:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440041728 00000100:00100000:2.0:1762166764.148071:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:2.0:1762166764.148082:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:e1e11365-ba0b-405b-99c9-a704373217f2+8:39200:x1847765440041728:12345-192.168.204.38@tcp:900:lfs.0 00000100:00100000:2.0:1762166764.148135:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:e1e11365-ba0b-405b-99c9-a704373217f2+8:39200:x1847765440041728:12345-192.168.204.38@tcp:900:lfs.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166764.148140:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:2.0:1762166764.149064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166764.149104:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440041856 00000100:00100000:0.0:1762166764.149110:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440041856 00000100:00100000:0.0:1762166764.149142:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1762166764.149151:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:e1e11365-ba0b-405b-99c9-a704373217f2+6:39200:x1847765440041856:12345-192.168.204.38@tcp:900:lfs.0 00000100:00100000:0.0:1762166764.149191:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:e1e11365-ba0b-405b-99c9-a704373217f2+6:39200:x1847765440041856:12345-192.168.204.38@tcp:900:lfs.0 Request processed in 43us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166764.149196:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:3.0:1762166764.150010:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166764.150067:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440041984 00000100:00100000:0.0:1762166764.150074:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440041984 00000100:00100000:0.0:1762166764.150108:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2608 00000100:00100000:0.0:1762166764.150118:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:39200:x1847765440041984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166764.150128:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166764.150143:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b56b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b796b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.150181:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0b572 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.150195:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0b572 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.150202:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0b572 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166764.150224:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1762166764.150227:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1762166764.150249:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b56b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b796b expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.150259:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0b572 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b796b expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.150264:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc4034900) 00010000:00010000:0.0:1762166764.150266:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166764.150268:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2c00, rc 0) 00000100:00100000:0.0:1762166764.150295:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39200:x1847765440041984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 181us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166764.150301:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2608 00000100:00100000:2.0:1762166764.151203:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166764.151236:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440042112 00000100:00100000:0.0:1762166764.151240:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440042112 00000100:00100000:0.0:1762166764.151270:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2609 00000100:00100000:0.0:1762166764.151278:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:39200:x1847765440042112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166764.151287:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166764.151299:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b579 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7972 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.151325:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b580 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166764.151337:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b580 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166764.151344:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b580 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166764.151364:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1762166764.151366:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1762166764.151383:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b579 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7972 expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.151391:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b580 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7972 expref: 7 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166764.151396:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff945bc4034d00) 00010000:00010000:0.0:1762166764.151398:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166764.151399:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3800, rc 0) 00000100:00100000:0.0:1762166764.151424:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:39200:x1847765440042112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 148us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166764.151428:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2609 00000100:00100000:2.0:1762166764.152657:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166764.152730:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440042368 00000100:00100000:3.0:1762166764.152747:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440042368 00000100:00100000:3.0:1762166764.152781:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2610 00000100:00100000:3.0:1762166764.152792:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39200:x1847765440042368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166764.152803:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166764.152814:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b587 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7979 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.152874:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.152885:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.152894:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.152909:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.152916:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.152930:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.152988:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.152996:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153002:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153008:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166764.153011:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153018:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153028:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc4034900) 00010000:00010000:3.0:1762166764.153031:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166764.153043:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153053:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b58e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153063:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153069:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153075:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153089:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166764.153092:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153098:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153107:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945bc4694300) 00010000:00010000:3.0:1762166764.153109:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166764.153112:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153118:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b595 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.153143:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b587 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7979 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.153153:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc4034900) 00010000:00010000:3.0:1762166764.153155:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166764.153159:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b587 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7979 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.153168:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca600, rc 0) 00000100:00100000:3.0:1762166764.153205:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39200:x1847765440042368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 416us (550us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166764.153213:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2610 00000100:00100000:3.0:1762166764.154362:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166764.154415:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440042624 00000100:00100000:1.0:1762166764.154420:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440042624 00000100:00100000:1.0:1762166764.154449:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2611 00000100:00100000:1.0:1762166764.154457:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39200:x1847765440042624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166764.154465:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166764.154473:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b59c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7980 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166764.154574:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 4096 00000001:00080000:3.0:1762166764.155547:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968874 is committed 00000001:00100000:3.0:1762166764.155569:0:6475:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1e11365-ba0b-405b-99c9-a704373217f2 00000001:00100000:3.0:1762166764.155576:0:6475:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fd0f52a9-204e-4869-b8da-3af938f6f960 00000001:00080000:3.0:1762166764.155583:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968873 is committed 00000020:00080000:3.0:1762166764.155591:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 42 batchid updated 00000020:00000080:3.0:1762166764.155615:0:6475:0:(genops.c:904:class_export_put()) final put ffff945cf4170800/fd0f52a9-204e-4869-b8da-3af938f6f960 00000020:00080000:1.0:1762166764.155632:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 42 00000020:00000080:2.0:1762166764.155669:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf4170800/fd0f52a9-204e-4869-b8da-3af938f6f960 for lustre-MDT0000 00000004:00080000:1.0:1762166764.155686:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc402fb40 with version 17 00000020:00080000:1.0:1762166764.155702:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 42 cancel update log [0x240000401:0x3:0x0].7: rc = 0 00010000:00010000:3.0:1762166764.155723:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b59c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7980 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00000020:00000080:2.0:1762166764.155734:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bccb4e800 for lustre-MDT0000 00010000:00010000:3.0:1762166764.155745:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166764.155751:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166764.155758:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b59c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7980 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1762166764.155763:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 42 cancel update log [0x200000400:0x2:0x0].19: rc = 0 00010000:00010000:3.0:1762166764.155777:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000020:00080000:1.0:1762166764.155779:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 42 00000004:00080000:1.0:1762166764.155792:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 17 rpc_version 17 00000020:00100000:1.0:1762166764.155818:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166764.155828:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc558a680 x1847765446793856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166764.155853:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:39200:x1847765440042624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1393us (1496us total) trans 4294968874 rc 301/301 00000100:00100000:1.0:1762166764.155854:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446793856:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166764.155880:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2611 00000100:00100000:1.0:1762166764.155932:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166764.155954:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446793856 00000100:00100000:2.0:1762166764.155959:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446793856 00000100:00100000:1.0:1762166764.155979:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166764.156004:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1762166764.156014:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8087:x1847765446793856:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166764.156143:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8087:x1847765446793856:12345-0@lo:1000:osp_up1-0.0 Request processed in 129us (211us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1762166764.156153:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1762166764.156180:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446793856:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166764.157292:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166764.157346:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440042880 00000100:00100000:3.0:1762166764.157352:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440042880 00000100:00100000:3.0:1762166764.157390:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2612 00000100:00100000:3.0:1762166764.157400:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:39200:x1847765440042880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166764.157410:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166764.157421:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b5aa lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7987 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.157460:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157472:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157507:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157522:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157529:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157536:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157606:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b5bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157614:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b5bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157621:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b5bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166764.157630:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x2:0x0]: returning size 10485760 00010000:00010000:3.0:1762166764.157676:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157683:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157689:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157695:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166764.157698:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157714:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157724:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc4034900) 00010000:00010000:3.0:1762166764.157727:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166764.157731:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157737:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b5b1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157745:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157751:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157757:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157762:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166764.157764:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157770:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157777:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945bc4694500) 00010000:00010000:3.0:1762166764.157779:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166764.157782:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157788:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5b8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166764.157825:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b5aa lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7987 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.157837:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b5bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7987 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166764.157844:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc4694f00) 00010000:00010000:3.0:1762166764.157847:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166764.157849:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6200, rc 0) 00000100:00100000:3.0:1762166764.157905:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39200:x1847765440042880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 507us (627us total) trans 4294968875 rc 0/0 00000100:00100000:3.0:1762166764.157912:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2612 00000100:00100000:3.0:1762166764.158877:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166764.158911:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440043136 00000100:00100000:0.0:1762166764.158917:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440043136 00000100:00100000:0.0:1762166764.158950:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 749 00000100:00100000:0.0:1762166764.158959:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39200:x1847765440043136:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166764.159074:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39200:x1847765440043136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 116us (196us total) trans 4294968876 rc 0/0 00000100:00100000:0.0:1762166764.159081:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 749 00000100:00100000:1.0:1762166764.159964:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166764.160010:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440043392 00000100:00100000:0.0:1762166764.160021:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440043392 00000100:00100000:0.0:1762166764.160059:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 750 00000100:00100000:0.0:1762166764.160067:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39200:x1847765440043392:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166764.160168:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39200:x1847765440043392:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 101us (203us total) trans 4294968877 rc 0/0 00000100:00100000:0.0:1762166764.160176:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 750 00010000:00010000:1.0:1762166764.307557:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166764.467270:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166764.467321:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440043520 00000100:00100000:2.0:1762166764.467332:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440043520 00000100:00100000:2.0:1762166764.467381:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 751 00000100:00100000:2.0:1762166764.467392:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39210:x1847765440043520:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:2.0:1762166764.467549:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39210:x1847765440043520:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 158us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166764.467559:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 751 00000100:00100000:1.0:1762166764.818586:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:0.0:1762166764.818601:0:9996:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 383967121851ns, next at 384967118486ns, rc = 0 00000100:00100000:2.0:1762166764.818610:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446794112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166764.818610:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446793984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166764.818673:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166764.818709:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446793984 00000100:00100000:2.0:1762166764.818714:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166764.818718:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446793984 00000100:00100000:2.0:1762166764.818755:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446794112 00000100:00100000:2.0:1762166764.818760:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446794112 00000100:00100000:0.0:1762166764.818782:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1762166764.818792:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1762166764.818796:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446793984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166764.818805:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446794112:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1762166764.818817:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1762166764.818828:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 19275456 pending 10559488 free 3902517248 avail 3670994944 00002000:00000024:0.0:1762166764.818828:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 19275456 pending 10559488 free 3902517248 avail 3670994944 00000100:00100000:1.0:1762166764.818898:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446794112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166764.818901:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446793984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166764.818912:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1762166764.818921:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446794112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1762166764.818924:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1762166764.818950:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446793984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1762166765.330655:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166765.330688:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166765.330707:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446794240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166765.330766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166765.330802:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446794240 00000100:00100000:2.0:1762166765.330810:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446794240 00000100:00100000:2.0:1762166765.330865:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1762166765.330873:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446794240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1762166765.330902:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1762166765.330952:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446794240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166765.330958:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1762166765.330999:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446794240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166765.842597:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446794368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166765.842655:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166765.842698:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446794368 00000100:00100000:3.0:1762166765.842707:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446794368 00000100:00100000:3.0:1762166765.842761:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1762166765.842772:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446794368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1762166765.842807:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446252544 avail 1300013056 00000100:00100000:3.0:1762166765.842872:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446794368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166765.842880:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1762166765.842900:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446794368:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1762166766.354603:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166766.491633:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166766.491682:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440043776 00000100:00100000:1.0:1762166766.491693:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440043776 00000100:00100000:1.0:1762166766.491750:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2613 00000100:00100000:1.0:1762166766.491758:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39650:x1847765440043776:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:1.0:1762166766.491830:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166766.491867:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b5bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7987 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166766.491893:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945bc4694f00) 00010000:00010000:1.0:1762166766.491914:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0b572 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b796b expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166766.491927:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945bc4034900) 00010000:00010000:1.0:1762166766.491932:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166766.491956:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 3/0,1 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.491969:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.491979:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.491992:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.491999:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492007:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492091:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492096:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492101:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00080000:0.0:1762166766.492129:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1762166766.492306:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].103, 64 off16536 00000004:00080000:1.0:1762166766.492314:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385640836198ns, next at 386640833796ns, rc = 0 00000040:00080000:1.0:1762166766.492336:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].107, 64 off16888 00000004:00080000:1.0:1762166766.492342:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385640864365ns, next at 386640863373ns, rc = 0 00010000:00010000:1.0:1762166766.492389:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492399:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492404:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492408:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492412:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492415:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492430:0:6495:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166766.492444:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166766.492451:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166766.492454:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492460:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166766.492460:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492471:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166766.492510:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166766.492511:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166766.492519:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492521:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166766.492536:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492542:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945cd0738500) 00010000:00010000:1.0:1762166766.492545:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762166766.492548:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492552:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b5db lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166766.492555:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2:0x0].0x0 (ffff945cd0738500) 00010000:00010000:0.0:1762166766.492567:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166766.492571:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166766.492577:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b5e2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166766.492598:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166766.492601:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166766.492603:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166766.492645:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492650:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492653:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492656:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166766.492658:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492670:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492676:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166766.492677:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166766.492679:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 2/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492682:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b5cd lrc: 0/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00010000:1.0:1762166766.492694:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000093e0d9dd reply state 0000000077feabbd transno 4294968878 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492701:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166766.492704:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945cd0738700) 00010000:00010000:1.0:1762166766.492706:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166766.492707:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166766.492775:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39650:x1847765440043776:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1019us (1157us total) trans 4294968878 rc 0/0 00000100:00100000:1.0:1762166766.492781:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2613 00000001:02000400:0.0:1762166767.033783:0:30817:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 45: Verify setstripe/getstripe with YAML with FLR file ========================================================== 05:46:06 (1762166766) 00000100:00100000:1.0:1762166767.055641:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.055697:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440043904 00000100:00100000:3.0:1762166767.055706:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440043904 00000100:00100000:3.0:1762166767.055769:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2614 00000100:00100000:3.0:1762166767.055781:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39795:x1847765440043904:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166767.055833:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166767.055849:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b5e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b798e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.055901:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.055914:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.055927:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.055942:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.055949:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.055953:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.055987:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.055993:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.055999:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056005:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.056009:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056042:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056058:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166767.056061:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.056067:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056073:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b5f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056085:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056091:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056096:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056101:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.056103:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056107:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056113:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c89c56e (ffff945bc4694300) 00010000:00010000:3.0:1762166767.056114:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.056116:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056120:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b5f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.056151:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b5e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b798e expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.056159:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166767.056161:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.056164:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0b5e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b798e expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.056172:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7000, rc 0) 00000100:00100000:3.0:1762166767.056226:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39795:x1847765440043904:12345-192.168.204.38@tcp:101:rm.0 Request processed in 447us (592us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166767.056234:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2614 00000100:00100000:2.0:1762166767.078526:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.078563:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440044032 00000100:00100000:3.0:1762166767.078574:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440044032 00000100:00100000:3.0:1762166767.078628:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2615 00000100:00100000:3.0:1762166767.078638:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39804:x1847765440044032:12345-192.168.204.38@tcp:41:stat.0 00000004:00000024:3.0:1762166767.078685:0:6495:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7814463488 avail 7340859392 00000100:00100000:3.0:1762166767.078751:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39804:x1847765440044032:12345-192.168.204.38@tcp:41:stat.0 Request processed in 115us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166767.078758:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2615 00000100:00100000:1.0:1762166767.099677:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166767.099734:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440044160 00000100:00100000:2.0:1762166767.099744:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440044160 00000100:00080000:0.0:1762166767.099791:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166767.099822:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:2.0:1762166767.099834:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e1e11365-ba0b-405b-99c9-a704373217f2+7:39811:x1847765440044160:12345-192.168.204.38@tcp:700:lfs.0 00000100:00100000:2.0:1762166767.099924:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e1e11365-ba0b-405b-99c9-a704373217f2+7:39811:x1847765440044160:12345-192.168.204.38@tcp:700:lfs.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.099932:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:1.0:1762166767.100866:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.100896:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440044416 00000100:00100000:3.0:1762166767.100900:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440044416 00000100:00100000:3.0:1762166767.100927:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2616 00000100:00100000:3.0:1762166767.100932:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:39811:x1847765440044416:12345-192.168.204.38@tcp:36:lfs.0 00000100:00100000:3.0:1762166767.101011:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446794496:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1762166767.101052:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166767.101090:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446794496 00000100:00100000:3.0:1762166767.101094:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.101095:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446794496 00000100:00100000:2.0:1762166767.101124:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1762166767.101129:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6495:x1847765446794496:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1762166767.101177:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6495:x1847765446794496:12345-0@lo:1000:mdt00_001.0 Request processed in 48us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.101182:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1762166767.101210:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446794496:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1762166767.101246:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446794624:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1762166767.101260:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166767.101275:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.101294:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446794624 00000100:00100000:2.0:1762166767.101299:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446794624 00000100:00100000:2.0:1762166767.101327:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1762166767.101333:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6495:x1847765446794624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1762166767.101397:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6495:x1847765446794624:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (135us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166767.101402:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1762166767.101428:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446794624:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1762166767.101470:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.101503:0:6495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.101513:0:6495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166767.101525:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446794752:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1762166767.101546:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166767.101569:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446794752 00000100:00100000:3.0:1762166767.101573:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.101573:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446794752 00000100:00100000:2.0:1762166767.101596:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1762166767.101600:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6495:x1847765446794752:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1762166767.101606:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166767.101617:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0b5fe expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.101634:0:6499:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.101649:0:6499:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0b5fe expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.101666:0:6499:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.101675:0:6499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 11 pid: 6495 timeout: 486 lvb_type: 0 00000100:00100000:2.0:1762166767.101683:0:6499:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe32300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6499:1847765446794880:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166767.101719:0:6499:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eaf780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.102547:0:6499:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe32300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6499:1847765446794880:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166767.102566:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b5fe expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.102575:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166767.102578:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166767.102581:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b5fe expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.102589:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac800, rc 0) 00000100:00100000:2.0:1762166767.102623:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6495:x1847765446794752:12345-0@lo:101:mdt00_001.0 Request processed in 1021us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.102630:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1762166767.102640:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446794752:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1762166767.102653:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.102659:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166767.103101:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.103140:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440044544 00000100:00100000:0.0:1762166767.103145:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440044544 00010000:00010000:0.0:1762166767.103166:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 12 pid: 6495 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1762166767.103193:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 620 00000100:00100000:0.0:1762166767.103200:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440044544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166767.103209:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166767.103214:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 12 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.103226:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 12 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.103243:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b548 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b795d expref: 12 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.103254:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166767.103265:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b5fe expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.103274:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0b5fe expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.103281:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0b5fe expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.103303:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b5fe expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.103312:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8398:1847765446795008:0@lo:105: 00000100:00100000:0.0:1762166767.103338:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166767.103364:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446795008 00000100:00100000:3.0:1762166767.103369:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446795008 00000100:00100000:0.0:1762166767.103372:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc40769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166767.103396:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1762166767.103407:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8398:x1847765446795008:12345-0@lo:105: 00010000:00010000:3.0:1762166767.103414:0:8397:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.103420:0:8397:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.103425:0:8397:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.103429:0:8397:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.103434:0:8397:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.103438:0:8397:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.103455:0:8397:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945bc95c7000) 00000100:00100000:3.0:1762166767.103500:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8398:x1847765446795008:12345-0@lo:105: Request processed in 93us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166767.103505:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166767.103506:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:1.0:1762166767.103517:0:6495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166767.103544:0:6495:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1762166767.103549:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:8398:1847765446795008:0@lo:105: 00010000:00010000:0.0:1762166767.103563:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166767.103573:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.103581:0:6495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.103589:0:6495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166767.103601:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440044544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 399us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166767.103604:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795136:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1762166767.103617:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 620 00000100:00100000:1.0:1762166767.103641:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166767.103666:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.103688:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446795136 00000100:00100000:2.0:1762166767.103693:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446795136 00000100:00100000:2.0:1762166767.103724:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1762166767.103730:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6495:x1847765446795136:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1762166767.103739:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166767.103750:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b613 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0b60c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.103766:0:6499:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b613 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0b60c expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.103775:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b613 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b60c expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.103782:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c89c56e (ffff945bc477f400) 00010000:00010000:2.0:1762166767.103784:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166767.103787:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad200, rc 0) 00000100:00100000:2.0:1762166767.103826:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795136:12345-0@lo:101:mdt00_001.0 Request processed in 96us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.103833:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1762166767.103859:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795136:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1762166767.103872:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.103882:0:6495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166767.103906:0:6495:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1762166767.103931:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795264:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.103955:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166767.103976:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.103987:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446795264 00000100:00100000:2.0:1762166767.103990:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446795264 00000100:00100000:2.0:1762166767.104007:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1762166767.104011:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1762166767.104047:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795264:12345-0@lo:1000:mdt00_001.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.104051:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1762166767.104066:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795264:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.104098:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795392:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.104119:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166767.104145:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.104163:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446795392 00000100:00100000:2.0:1762166767.104167:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446795392 00000100:00100000:2.0:1762166767.104191:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1762166767.104199:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1762166767.104277:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795392:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (156us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166767.104285:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1762166767.104314:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795392:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.104370:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795520:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.104393:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166767.104415:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.104455:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446795520 00000100:00100000:2.0:1762166767.104461:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446795520 00000100:00100000:2.0:1762166767.104504:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1762166767.104512:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1762166767.104564:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795520:12345-0@lo:1000:mdt00_001.0 Request processed in 51us (168us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166767.104570:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1762166767.104576:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795520:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.104622:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795648:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.104642:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166767.104662:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.104668:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446795648 00000100:00100000:2.0:1762166767.104673:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446795648 00000100:00100000:2.0:1762166767.104696:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1762166767.104704:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1762166767.104751:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795648:12345-0@lo:1000:mdt00_001.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.104758:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1762166767.104762:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795648:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.104816:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795776:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.104837:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166767.104854:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.104864:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446795776 00000100:00100000:2.0:1762166767.104869:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446795776 00000100:00100000:2.0:1762166767.104893:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1762166767.104900:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1762166767.104945:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6495:x1847765446795776:12345-0@lo:1000:mdt00_001.0 Request processed in 45us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.104954:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1762166767.104957:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446795776:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1762166767.105755:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].8, 2152 off41976 00000040:00080000:1.0:1762166767.105844:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].7, 2352 off42768 00000004:00080000:1.0:1762166767.105850:0:6495:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945bc3731b40 with version 16 00000004:00080000:0.0:1762166767.105887:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 16 rpc_version 16 00000020:00100000:0.0:1762166767.105913:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166767.105922:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945cf7838e00 x1847765446796032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166767.105937:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446796032:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166767.105971:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166767.105992:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc40769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.106007:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446796032 00000100:00100000:2.0:1762166767.106011:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446796032 00000100:00100000:2.0:1762166767.106030:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1762166767.106039:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7425:x1847765446796032:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166767.106443:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7425:x1847765446796032:12345-0@lo:1000:osp_up0-1.0 Request processed in 403us (471us total) trans 4294968879 rc 0/0 00000100:00100000:2.0:1762166767.106448:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1762166767.106516:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446796032:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1762166767.106570:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.106579:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106588:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106603:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.106620:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106627:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106646:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.106652:0:6495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106659:0:6495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166767.106670:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446796160:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1762166767.106690:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166767.106709:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.106718:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446796160 00000100:00100000:2.0:1762166767.106722:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446796160 00000100:00100000:2.0:1762166767.106741:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1762166767.106748:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6495:x1847765446796160:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1762166767.106758:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166767.106770:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b62f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0b628 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.106786:0:6499:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b62f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0b628 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.106795:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b62f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b628 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.106809:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166767.106812:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166767.106814:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cada00, rc 0) 00000100:00100000:2.0:1762166767.106837:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6495:x1847765446796160:12345-0@lo:101:mdt00_001.0 Request processed in 91us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.106841:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1762166767.106865:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446796160:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1762166767.106877:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.106886:0:6495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166767.106901:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000248be767 reply state 000000006a83dd49 transno 4294967416 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106912:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106918:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945cd0738200) 00010000:00010000:1.0:1762166767.106925:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166767.106928:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166767.106933:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.106940:0:6495:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166767.106946:0:6495:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000401:0x5:0x0] 00000004:00010000:1.0:1762166767.106952:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000248be767 reply state 000000006a83dd49 transno 4294967416 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106959:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.106965:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff945cd0738300) 00010000:00010000:1.0:1762166767.106967:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166767.106968:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1762166767.106972:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1:0x0]: returning size 4096 00000004:00080000:1.0:1762166767.106978:0:6495:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1762166767.106984:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.106990:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.106997:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.107017:0:6495:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1762166767.107021:0:6495:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1762166767.107026:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.107037:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166767.107039:0:6495:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.107045:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.107056:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7000 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:0.0:1762166767.107061:0:10257:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1762166767.107070:0:10257:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.107095:0:10257:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166767.107101:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39811:x1847765440044416:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 6165us (6232us total) trans 4294967416 rc 0/0 00010000:00010000:0.0:1762166767.107107:0:10257:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1762166767.107115:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2616 00010000:00010000:0.0:1762166767.107139:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.107147:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc95c7000/0x2f180c4effb0b5fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0b605 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.107159:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166767.107161:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446796288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166767.107162:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166767.107166:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166767.107199:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166767.107247:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446796288 00000100:00100000:0.0:1762166767.107252:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446796288 00000100:00100000:0.0:1762166767.107287:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1762166767.107295:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765446796288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166767.107303:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166767.107315:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b605 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb0b5fe expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.107334:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166767.107337:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166767.107371:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765446796288:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.107379:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1762166767.107393:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446796288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166767.114240:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.114284:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440044672 00000100:00100000:3.0:1762166767.114294:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440044672 00000100:00100000:3.0:1762166767.114365:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2617 00000100:00100000:3.0:1762166767.114375:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39814:x1847765440044672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166767.114394:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166767.114412:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7995 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.114470:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b63d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.114509:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.114520:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166767.114558:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1762166767.114561:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166767.114576:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.114598:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7995 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.114614:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b63d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7995 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.114622:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166767.114624:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166767.114628:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7a00, rc 0) 00000100:00100000:3.0:1762166767.114685:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39814:x1847765440044672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 311us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166767.114701:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2617 00000100:00100000:2.0:1762166767.115798:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.115841:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440044800 00000100:00100000:3.0:1762166767.115846:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440044800 00000100:00100000:3.0:1762166767.115874:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2618 00000100:00100000:3.0:1762166767.115883:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39814:x1847765440044800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166767.115892:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166767.115901:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b799c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.115929:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.115938:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.115945:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.115953:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.115961:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b613 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b60c expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.115969:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.115995:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b613 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0b60c expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166767.116008:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446796416:0@lo:104: 00000100:00100000:3.0:1762166767.116058:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166767.116094:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166767.116095:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446796416 00000100:00100000:2.0:1762166767.116100:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446796416 00000100:00100000:2.0:1762166767.116130:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1762166767.116140:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1847765446796416:12345-0@lo:104: 00010000:00010000:2.0:1762166767.116148:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.116194:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1762166767.116198:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1847765446796416:12345-0@lo:104: Request processed in 59us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.116203:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1762166767.116216:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166767.116224:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166767.116228:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446796416:0@lo:104: 00010000:00010000:1.0:1762166767.116234:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166767.116240:0:10256:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166767.116247:0:10256:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.116250:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.116270:0:10256:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.116275:0:10256:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166767.116295:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.116299:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b1400/0x2f180c4effb0b60c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b613 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166767.116308:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762166767.116324:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446796544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166767.116330:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.116333:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.116336:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166767.116350:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166767.116388:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446796544 00000100:00100000:0.0:1762166767.116393:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446796544 00010000:00010000:0.0:1762166767.116410:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b613 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0b60c expref: 9 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.116434:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1762166767.116441:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765446796544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166767.116450:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1762166767.117391:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968879 is committed 00000001:00080000:3.0:1762166767.117405:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968878 is committed 00000004:00080000:3.0:1762166767.117410:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00000004:00080000:3.0:1762166767.117420:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 94 committed 00010000:00010000:0.0:1762166767.117429:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.117437:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.117443:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.117449:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.117453:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.117459:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.117471:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x5c9a3b0c (ffff945cd0738700) 00010000:00010000:0.0:1762166767.117504:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.117508:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166767.117510:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446796672:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166767.117516:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0b5d4 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x5c9a3b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166767.117543:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166767.117546:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446796800:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166767.117583:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166767.117587:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b613 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0b60c expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.117600:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c89c56e (ffff945bc477f400) 00010000:00010000:0.0:1762166767.117604:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166767.117607:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446796672 00000100:00100000:3.0:1762166767.117611:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446796672 00010000:00010000:0.0:1762166767.117611:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.117617:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.117637:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166767.117650:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166767.117654:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446796800 00000100:00100000:3.0:1762166767.117658:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446796800 00010000:00010000:1.0:1762166767.117663:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166767.117668:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1762166767.117674:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446796544:12345-0@lo:103:ldlm_bl.0 Request processed in 1230us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.117682:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1762166767.117690:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446796672:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166767.117697:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:3.0:1762166767.117705:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446796800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762166767.117710:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:63 count 1 00002000:00080000:3.0:1762166767.117719:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:60 count 1 00000100:00080000:0.0:1762166767.117728:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166767.117732:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1762166767.117738:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 10485760, mtime: 0x690887eb, atime: 0x0, ctime: 0x690887eb, blocks: 0x5000 00002000:00010000:3.0:1762166767.117742:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 10485760, mtime: 0x690887eb, atime: 0x690887ea, ctime: 0x690887eb, blocks: 0x5000 00010000:00010000:2.0:1762166767.117746:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.117750:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.117767:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166767.117769:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166767.117770:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6495:1847765446796928:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1762166767.117771:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166767.117773:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166767.117778:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.117785:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.117793:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.117812:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.117815:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166767.117825:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166767.117829:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.117835:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.117842:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166767.117852:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731780 going to sleep for 11 seconds 00010000:00010000:3.0:1762166767.117866:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1762166767.117867:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446796928 00000100:00100000:0.0:1762166767.117872:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446796928 00010000:00010000:2.0:1762166767.117876:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1762166767.117883:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762166767.117889:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.117895:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166767.117898:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.117904:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00010000:00010000:1.0:1762166767.117907:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.117915:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6495:x1847765446796928:12345-0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1762166767.117920:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.117938:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b660 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.117957:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166767.117961:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.117969:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166767.117973:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.117979:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6495:x1847765446796928:12345-0@lo:1000:mdt00_001.0 Request processed in 66us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166767.117986:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.118005:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00010000:00010000:1.0:1762166767.118006:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.118015:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.118023:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.118034:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.118037:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.118039:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166767.118061:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6495:1847765446796928:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1762166767.118095:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b667 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118103:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b667 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118110:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b667 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166767.118123:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b667 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118133:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118140:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118145:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118150:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118155:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.118158:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118163:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118178:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166767.118181:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.118185:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118190:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b64b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118201:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118218:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118223:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118228:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.118230:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118235:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118243:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c89c56e (ffff945bc477f400) 00010000:00010000:0.0:1762166767.118245:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.118248:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118253:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b652 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c89c56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.118279:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b799c expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.118297:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b667 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b799c expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.118304:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff945bc4180200) 00010000:00010000:0.0:1762166767.118306:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166767.118308:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2e00, rc 0) 00000100:00100000:0.0:1762166767.118346:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:39814:x1847765440044800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2464us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.118353:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2618 00000100:00100000:0.0:1762166767.118397:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446796544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166767.119243:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.119276:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440044928 00000100:00100000:0.0:1762166767.119281:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440044928 00000100:00100000:0.0:1762166767.119316:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2619 00000100:00100000:0.0:1762166767.119324:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39814:x1847765440044928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.119334:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.119344:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b66e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79a3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.119377:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b675 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.119385:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b675 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.119392:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b675 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166767.119458:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166767.119467:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1762166767.119534:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0b66e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79a3 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.119546:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b675 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79a3 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.119552:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff945cd0738300) 00010000:00010000:0.0:1762166767.119554:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1762166767.119557:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3200, rc 0) 00000100:00100000:0.0:1762166767.119590:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39814:x1847765440044928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 267us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.119597:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2619 00000100:00100000:1.0:1762166767.120324:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.120360:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440045056 00000100:00100000:0.0:1762166767.120365:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440045056 00000100:00100000:0.0:1762166767.120394:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2620 00000100:00100000:0.0:1762166767.120402:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39814:x1847765440045056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.120410:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.120418:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b67c lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79aa expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.120441:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b683 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.120448:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b683 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.120455:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b683 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166767.120472:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1762166767.120499:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1762166767.120520:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0b67c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79aa expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.120532:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79aa expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.120538:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945cd0738200) 00010000:00010000:0.0:1762166767.120541:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166767.120543:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3a00, rc 0) 00000100:00100000:0.0:1762166767.120572:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39814:x1847765440045056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 172us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.120579:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2620 00000100:00100000:1.0:1762166767.121242:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.121277:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440045184 00000100:00100000:0.0:1762166767.121282:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440045184 00000100:00100000:0.0:1762166767.121310:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2621 00000100:00100000:0.0:1762166767.121317:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:39814:x1847765440045184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.121325:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.121333:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0b68a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79b1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.121358:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.121367:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b62f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0b628 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.121373:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.121409:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b62f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0b628 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.121422:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446797056:0@lo:104: 00000100:00100000:0.0:1762166767.121451:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166767.121508:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166767.121513:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446797056 00000100:00100000:1.0:1762166767.121525:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446797056 00000100:00100000:1.0:1762166767.121564:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1762166767.121573:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1847765446797056:12345-0@lo:104: 00010000:00010000:1.0:1762166767.121584:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.121643:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1762166767.121650:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1847765446797056:12345-0@lo:104: Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.121652:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446797056:0@lo:104: 00000100:00100000:1.0:1762166767.121666:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1762166767.121672:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.121691:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166767.121698:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.121707:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166767.121713:0:7420:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166767.121722:0:7420:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.121745:0:7420:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.121752:0:7420:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166767.121782:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.121790:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc60b0000/0x2f180c4effb0b628 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0b62f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.121815:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446797184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1762166767.121843:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166767.121883:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446797184 00000100:00100000:0.0:1762166767.121889:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446797184 00010000:00010000:1.0:1762166767.121906:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166767.121910:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166767.121911:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b62f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0b628 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.121913:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166767.121949:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1762166767.121959:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446797184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166767.121969:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166767.122191:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0b62f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0b628 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.122204:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc477f500) 00010000:00010000:0.0:1762166767.122208:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.122215:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.122228:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.122251:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166767.122268:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.122275:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166767.122281:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446797184:12345-0@lo:103:ldlm_bl.0 Request processed in 325us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.122287:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000004:00200000:1.0:1762166767.122298:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1762166767.122302:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1762166767.122319:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446797184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166767.122323:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0b68a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79b1 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.122336:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79b1 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.122342:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc477f500) 00010000:00010000:1.0:1762166767.122344:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166767.122346:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2200, rc 0) 00000100:00100000:1.0:1762166767.122381:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39814:x1847765440045184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1063us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166767.122388:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2621 00000100:00100000:1.0:1762166767.123294:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.123337:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440045312 00000100:00100000:0.0:1762166767.123343:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440045312 00000100:00100000:0.0:1762166767.123382:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2622 00000100:00100000:0.0:1762166767.123392:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39814:x1847765440045312:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.123402:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.123412:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79b8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.123445:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123453:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123461:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123473:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123503:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123521:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123560:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123566:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123572:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123578:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123582:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.123586:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123591:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123599:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc477f500) 00010000:00010000:0.0:1762166767.123602:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.123606:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123611:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0b69f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123623:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123629:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123641:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123646:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.123649:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123655:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123662:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945bc4180800) 00010000:00010000:0.0:1762166767.123665:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.123667:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123673:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.123707:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b698 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79b8 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.123715:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc477f500) 00010000:00010000:0.0:1762166767.123718:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.123722:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0b698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79b8 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.123732:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2a00, rc 0) 00000100:00100000:0.0:1762166767.123767:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39814:x1847765440045312:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 378us (474us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166767.123774:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2622 00000100:00100000:0.0:1762166767.124908:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166767.124946:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440045440 00000100:00100000:1.0:1762166767.124952:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440045440 00000100:00100000:1.0:1762166767.124993:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2623 00000100:00100000:1.0:1762166767.125003:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39814:x1847765440045440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166767.125023:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166767.125037:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b6ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79bf expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.125072:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb0b6b4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.125082:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb0b6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.125093:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb0b6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166767.125149:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166767.125153:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1762166767.125165:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb0b6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166767.125184:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b6ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79bf expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.125200:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb0b6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79bf expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.125208:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff945cd0738300) 00010000:00010000:1.0:1762166767.125211:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166767.125213:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1600, rc 0) 00000100:00100000:1.0:1762166767.125251:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39814:x1847765440045440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 249us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166767.125260:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2623 00000100:00100000:1.0:1762166767.127027:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.127078:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440045568 00000100:00100000:0.0:1762166767.127083:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440045568 00000100:00100000:0.0:1762166767.127114:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1762166767.127122:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39814:x1847765440045568:12345-192.168.204.38@tcp:700:lfs.0 00000100:00100000:0.0:1762166767.127160:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39814:x1847765440045568:12345-192.168.204.38@tcp:700:lfs.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.127165:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:2.0:1762166767.127558:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446796672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9870us (10013us total) trans 21474836663 rc 0/0 00000100:00100000:2.0:1762166767.127571:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000004:00080000:0.0:1762166767.127595:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc95b1880/2, rc 0, transno 21474836663 00000100:00100000:0.0:1762166767.127603:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446796672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166767.127965:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166767.128009:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440045824 00000100:00100000:1.0:1762166767.128015:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440045824 00000100:00100000:1.0:1762166767.128050:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2624 00000100:00100000:1.0:1762166767.128061:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39814:x1847765440045824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166767.128070:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166767.128073:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166767.128090:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0b691 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79b1 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.128106:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc477f500) 00010000:00010000:1.0:1762166767.128115:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166767.128127:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b6bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79c6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.128195:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128206:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128215:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128228:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128235:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128243:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166767.128320:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446796800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10616us (10737us total) trans 17179869350 rc 0/0 00000100:00100000:3.0:1762166767.128327:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000004:00080000:2.0:1762166767.128354:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe33480/2, rc 0, transno 17179869350 00000100:00100000:2.0:1762166767.128370:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446796800:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166767.128584:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128593:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128599:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166767.128607:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1:0x0]: returning size 0 00010000:00010000:1.0:1762166767.128627:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128634:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128640:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128646:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128651:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166767.128655:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128661:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128668:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945cd0738500) 00010000:00010000:1.0:1762166767.128671:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166767.128674:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128699:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b6c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00010000:1.0:1762166767.128713:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008d2ab136 reply state 000000008ebd82fe transno 4294968880 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128723:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.128729:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:1.0:1762166767.128731:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166767.128733:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166767.128763:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b6bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.128779:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.128787:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:1.0:1762166767.128789:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166767.128792:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0800, rc 0) 00000100:00100000:1.0:1762166767.128839:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39814:x1847765440045824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 782us (875us total) trans 4294968880 rc 0/0 00000100:00100000:1.0:1762166767.128843:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2624 00000100:00100000:1.0:1762166767.130192:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.130231:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440046080 00000100:00100000:0.0:1762166767.130236:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440046080 00000100:00100000:0.0:1762166767.130271:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2625 00000100:00100000:0.0:1762166767.130287:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39814:x1847765440046080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.130302:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.130310:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0b6de lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79cd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.130361:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.130371:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.130380:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.130407:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.130427:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 12 pid: 6495 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1762166767.130440:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446797312:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166767.130520:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166767.131272:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446797312:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166767.131284:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166767.131433:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.131463:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440046208 00000100:00100000:0.0:1762166767.131467:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440046208 00010000:00010000:0.0:1762166767.131531:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 13 pid: 6495 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1762166767.131559:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 623 00000100:00100000:0.0:1762166767.131570:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440046208:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166767.131581:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166767.131588:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 13 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.131601:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 13 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.131619:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b6d0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79c6 expref: 13 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.131633:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:0.0:1762166767.131643:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.131651:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.131657:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.131680:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166767.131696:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.131704:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166767.131713:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440046208:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 145us (280us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166767.131723:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1:0x0]: returning size 0 00000100:00100000:0.0:1762166767.131723:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 623 00000004:00080000:1.0:1762166767.131860:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x40:0x0], index 0: 0 00000004:00080000:1.0:1762166767.131866:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3d:0x0], index 1: 0 00000004:00080000:1.0:1762166767.131868:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x41:0x0], index 0: 0 00000004:00080000:1.0:1762166767.131871:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00000004:00080000:1.0:1762166767.131873:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3e:0x0], index 1: 0 00000004:00080000:1.0:1762166767.131876:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x43:0x0], index 0: 0 00000004:00080000:1.0:1762166767.131878:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3f:0x0], index 1: 0 00010000:00010000:1.0:1762166767.131999:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.132007:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.132013:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.132018:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166767.132021:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.132027:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.132032:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:1.0:1762166767.132034:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166767.132036:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.132040:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b6e5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166767.132066:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0b6de lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79cd expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.132072:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:1.0:1762166767.132074:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166767.132076:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0b6de lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79cd expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166767.132084:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4c00, rc 0) 00000100:00100000:1.0:1762166767.132109:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39814:x1847765440046080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1832us (1919us total) trans 4294968881 rc 301/301 00000100:00100000:1.0:1762166767.132113:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2625 00000100:00100000:1.0:1762166767.133188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166767.133230:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440046464 00000100:00100000:2.0:1762166767.133248:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440046464 00000100:00100000:2.0:1762166767.133279:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 752 00000100:00100000:2.0:1762166767.133298:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39814:x1847765440046464:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166767.133426:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39814:x1847765440046464:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 130us (238us total) trans 4294968882 rc 0/0 00000100:00100000:2.0:1762166767.133433:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 752 00000100:00100000:2.0:1762166767.134214:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.134260:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440046720 00000100:00100000:0.0:1762166767.134266:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440046720 00000100:00100000:0.0:1762166767.134296:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 753 00000100:00100000:0.0:1762166767.134306:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39814:x1847765440046720:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166767.134394:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:39814:x1847765440046720:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 90us (179us total) trans 4294968883 rc 0/0 00000100:00100000:0.0:1762166767.134402:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 753 00000100:00100000:1.0:1762166767.137932:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.137969:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440046976 00000100:00100000:0.0:1762166767.137975:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440046976 00000100:00100000:0.0:1762166767.138004:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2626 00000100:00100000:0.0:1762166767.138011:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39815:x1847765440046976:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1762166767.138023:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.138025:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166767.138041:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0b683 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79aa expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.138064:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945cd0738200) 00010000:00010000:0.0:1762166767.138067:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166767.138077:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6f3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79d4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.138153:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.138161:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138167:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138206:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.138210:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138214:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166767.138295:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446797440:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1762166767.138329:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166767.138358:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37310c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166767.138361:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446797440 00000100:00100000:1.0:1762166767.138365:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446797440 00000100:00100000:1.0:1762166767.138397:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1762166767.138402:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6495:x1847765446797440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1762166767.138450:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6495:x1847765446797440:12345-0@lo:1000:mdt00_001.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166767.138455:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1762166767.138507:0:6495:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968879 gen 2 00000004:00080000:0.0:1762166767.138514:0:6495:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968879 committed transno 4294968879 00000100:00100000:0.0:1762166767.138539:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6495:1847765446797440:0@lo:1000:mdt00_001.0 00000004:00080000:0.0:1762166767.138741:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x14:0x0], index 0: 0 00010000:00010000:0.0:1762166767.138873:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b708 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.138882:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b708 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138890:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b708 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138912:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138919:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138925:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138931:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138938:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.138942:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138949:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138957:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945cd0738200) 00010000:00010000:0.0:1762166767.138960:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.138964:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.138970:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b6fa lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00010000:0.0:1762166767.138990:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bba2f06f reply state 00000000ee29f5e1 transno 4294967417 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.139000:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.139007:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xe0d9f819 (ffff945bc4180800) 00010000:00010000:0.0:1762166767.139009:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166767.139011:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166767.139033:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b6f3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79d4 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.139046:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b708 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79d4 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.139054:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:0.0:1762166767.139057:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166767.139060:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5800, rc 0) 00000100:00100000:0.0:1762166767.139098:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39815:x1847765440046976:12345-192.168.204.38@tcp:101:bash.0 Request processed in 1087us (1170us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1762166767.139106:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2626 00000100:00100000:1.0:1762166767.145119:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.145166:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440047232 00000100:00100000:0.0:1762166767.145190:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440047232 00000100:00100000:0.0:1762166767.145237:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2627 00000100:00100000:0.0:1762166767.145249:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:39815:x1847765440047232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.145270:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.145287:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b716 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79db expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.145373:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145384:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145406:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145419:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145425:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145431:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145505:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145514:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145519:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145524:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145529:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.145532:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145547:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145557:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4180c00) 00010000:00010000:0.0:1762166767.145559:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.145562:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145568:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b71d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145578:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145592:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145597:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145600:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.145602:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145607:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145611:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:0.0:1762166767.145613:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.145616:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145620:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b724 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.145651:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b716 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79db expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.145660:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4180c00) 00010000:00010000:0.0:1762166767.145662:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166767.145665:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b716 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79db expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.145676:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4000, rc 0) 00000100:00100000:0.0:1762166767.145721:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:39815:x1847765440047232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 475us (611us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166767.145729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2627 00000100:00100000:2.0:1762166767.146866:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.146913:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440047488 00000100:00100000:0.0:1762166767.146919:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440047488 00000100:00100000:0.0:1762166767.146951:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2628 00000100:00100000:0.0:1762166767.146960:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39815:x1847765440047488:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.146974:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.146987:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b72b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79e2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166767.147081:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1:0x0]: returning size 4096 00000001:00080000:3.0:1762166767.148212:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967418 is committed 00000020:00080000:3.0:1762166767.148226:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc3731180 refcount 2 committed 0 result 0 batchid 9 00000020:00080000:3.0:1762166767.148231:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5e1e500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc3731b40 00000020:00080000:3.0:1762166767.148235:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].7 00000020:00080000:3.0:1762166767.148238:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5e1ee00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf78c5800 00010000:00010000:0.0:1762166767.148240:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166767.148241:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].8 00010000:00010000:0.0:1762166767.148252:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166767.148259:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 8 committed 00010000:00010000:0.0:1762166767.148261:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148275:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00000001:00080000:3.0:1762166767.148276:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967415 is committed 00010000:00010000:0.0:1762166767.148280:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000001:00100000:3.0:1762166767.148283:0:7412:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e1e11365-ba0b-405b-99c9-a704373217f2 00000020:00080000:2.0:1762166767.148287:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 9 committed batchid 7 00000001:00100000:3.0:1762166767.148292:0:7412:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fd0f52a9-204e-4869-b8da-3af938f6f960 00010000:00010000:0.0:1762166767.148292:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166767.148301:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967414 is committed 00000020:00000080:3.0:1762166767.148306:0:7412:0:(genops.c:904:class_export_put()) final put ffff945bcc02f800/fd0f52a9-204e-4869-b8da-3af938f6f960 00010000:00010000:0.0:1762166767.148308:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff945cd0738300) 00010000:00010000:0.0:1762166767.148312:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.148315:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148323:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b61a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:2.0:1762166767.148324:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 7 00000020:00080000:3.0:1762166767.148338:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 8 batchid updated 00010000:00010000:0.0:1762166767.148338:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00000080:2.0:1762166767.148347:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff945bcc02f800/fd0f52a9-204e-4869-b8da-3af938f6f960 for lustre-MDT0001 00010000:00010000:0.0:1762166767.148348:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148357:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148361:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.148365:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166767.148371:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446797568:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1762166767.148372:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148387:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945cd0738200) 00010000:00010000:0.0:1762166767.148390:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00000080:2.0:1762166767.148394:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bcc02b800 for lustre-MDT0001 00010000:00010000:0.0:1762166767.148399:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148407:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0b621 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.148409:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b72b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79e2 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.148428:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4180700) 00010000:00010000:3.0:1762166767.148432:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166767.148435:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166767.148437:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166767.148441:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b72b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79e2 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.148451:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148460:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148467:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.148468:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5000, rc 0) 00010000:00010000:0.0:1762166767.148471:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166767.148503:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446797568 00010000:00010000:0.0:1762166767.148505:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166767.148508:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446797568 00010000:00010000:0.0:1762166767.148519:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xe0d9f819 (ffff945bc4180800) 00010000:00010000:0.0:1762166767.148522:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.148526:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.148532:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b701 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166767.148538:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39815:x1847765440047488:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1576us (1668us total) trans 4294967418 rc 301/301 00000100:00100000:3.0:1762166767.148550:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2628 00000100:00100000:2.0:1762166767.148553:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00080000:0.0:1762166767.148561:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166767.148563:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446797568:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1762166767.148580:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:19 count 1 00002000:00010000:2.0:1762166767.148605:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x13:0x0] initial LVB size: 10485760, mtime: 0x690887e7, atime: 0x690887e7, ctime: 0x690887e8, blocks: 0x5000 00010000:00010000:2.0:1762166767.148610:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.148619:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166767.148621:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166767.148625:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.148632:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.148637:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.148642:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.148658:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166767.148684:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166767.148692:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.148715:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166767.148719:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.148727:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.148741:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.148748:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cad000/0x2f180c4effb0b739 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.148768:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166767.148771:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166767.148773:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166767.149902:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.149940:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440047616 00000100:00100000:3.0:1762166767.149945:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440047616 00000100:00100000:3.0:1762166767.149989:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2629 00000100:00100000:3.0:1762166767.150000:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:39815:x1847765440047616:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166767.150041:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150050:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150056:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150064:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150069:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150081:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150120:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150125:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150130:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166767.150155:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1:0x0]: returning size 0 00000004:00200000:3.0:1762166767.150159:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166767.150165:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150173:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150177:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150181:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150184:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150187:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.150189:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150193:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150204:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694f00) 00010000:00010000:3.0:1762166767.150206:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.150209:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150212:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b740 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150226:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150233:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150238:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150244:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.150248:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150253:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150262:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166767.150265:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.150268:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150273:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b747 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150283:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150295:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150301:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150306:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.150309:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150315:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150323:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945bc4694500) 00010000:00010000:3.0:1762166767.150325:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.150327:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.150331:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b74e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166767.150369:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:39815:x1847765440047616:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 373us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166767.150375:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2629 00000100:00100000:1.0:1762166767.151144:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.151193:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440047744 00000100:00100000:3.0:1762166767.151199:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440047744 00000100:00100000:3.0:1762166767.151229:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2630 00000100:00100000:3.0:1762166767.151239:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:39815:x1847765440047744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166767.151253:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166767.151264:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b755 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79e9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.151289:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79e9 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.151301:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79e9 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.151309:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694600) 00010000:00010000:3.0:1762166767.151312:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.151315:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6000, rc 0) 00000100:00100000:3.0:1762166767.151348:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39815:x1847765440047744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 111us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166767.151357:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2630 00000100:00100000:1.0:1762166767.152605:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.152646:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440047872 00000100:00100000:0.0:1762166767.152652:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440047872 00000100:00100000:0.0:1762166767.152697:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 754 00000100:00100000:0.0:1762166767.152707:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39815:x1847765440047872:12345-192.168.204.38@tcp:37:lfs.0 00000100:00100000:0.0:1762166767.154781:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39815:x1847765440047872:12345-192.168.204.38@tcp:37:lfs.0 Request processed in 2073us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.154792:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 754 00000100:00100000:2.0:1762166767.155074:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446797568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6512us (6638us total) trans 17179869351 rc 0/0 00000100:00100000:2.0:1762166767.155083:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000004:00080000:1.0:1762166767.155124:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4013b80/2, rc 0, transno 17179869351 00000100:00100000:1.0:1762166767.155132:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446797568:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1762166767.156374:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.156404:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440048000 00000100:00100000:3.0:1762166767.156410:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440048000 00000100:00100000:3.0:1762166767.156440:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2631 00000100:00100000:3.0:1762166767.156447:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:39815:x1847765440048000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166767.156459:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166767.156473:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b75c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79f0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.156516:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b75c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f0 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.156526:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b75c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f0 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.156533:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694b00) 00010000:00010000:3.0:1762166767.156541:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.156544:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6e00, rc 0) 00000100:00100000:3.0:1762166767.156570:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39815:x1847765440048000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 125us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166767.156582:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2631 00000100:00100000:1.0:1762166767.157764:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.157814:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440048128 00000100:00100000:0.0:1762166767.157818:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440048128 00000100:00100000:0.0:1762166767.157841:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 755 00000100:00100000:0.0:1762166767.157853:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39815:x1847765440048128:12345-192.168.204.38@tcp:37:lfs.0 00000100:00100000:0.0:1762166767.159375:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39815:x1847765440048128:12345-192.168.204.38@tcp:37:lfs.0 Request processed in 1522us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.159382:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 755 00000100:00100000:1.0:1762166767.161569:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166767.161607:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166767.161623:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440048256 00000100:00100000:2.0:1762166767.161632:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440048256 00000100:00100000:0.0:1762166767.161650:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440048384 00000100:00100000:0.0:1762166767.161656:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440048384 00000100:00080000:1.0:1762166767.161683:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166767.161700:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 954 00000100:00100000:0.0:1762166767.161705:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 602 00000100:00100000:2.0:1762166767.161714:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+6:2418:x1847765440048256:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166767.161721:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440048384:12345-192.168.204.38@tcp:63:ll_sa.0 00010000:00010000:2.0:1762166767.161732:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.161747:0:6500:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166767.161750:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79f7 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.161762:0:6500:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b76a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b79fe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.161822:0:6500:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.161836:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.161847:0:6500:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.161858:0:6500:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 00002000:00010000:2.0:1762166767.161859:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166767.161872:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166767.161878:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166767.161880:0:6500:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166767.161881:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166767.161888:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 7 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166767.161899:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 7 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166767.161907:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad400, rc 0) 00000100:00100000:2.0:1762166767.161940:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+7:2418:x1847765440048256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 231us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.161945:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 954 00010000:00010000:0.0:1762166767.161954:0:6500:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b77f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.161969:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b77f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.161978:0:6500:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b77f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 00000004:00200000:0.0:1762166767.162010:0:6500:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1:0x0]: returning size 0 00000004:00200000:0.0:1762166767.162015:0:6500:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166767.162045:0:6500:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b77f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162056:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b77f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162063:0:6500:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162070:0:6500:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162076:0:6500:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162083:0:6500:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.162088:0:6500:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162095:0:6500:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162107:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694b00) 00010000:00010000:0.0:1762166767.162110:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.162114:0:6500:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162126:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162139:0:6500:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162145:0:6500:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162156:0:6500:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162161:0:6500:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.162164:0:6500:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162169:0:6500:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162177:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:0.0:1762166767.162179:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.162182:0:6500:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162188:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 00010000:00010000:0.0:1762166767.162212:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b76a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79fe expref: 16 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.162222:0:6500:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b77f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79fe expref: 15 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.162238:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945bc4180c00) 00010000:00010000:0.0:1762166767.162241:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166767.162243:0:6500:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5a00, rc 0) 00000100:00100000:0.0:1762166767.162282:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440048384:12345-192.168.204.38@tcp:63:ll_sa.0 Request processed in 568us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.162292:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 602 00000100:00100000:1.0:1762166767.163184:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166767.163225:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440048512 00000100:00100000:2.0:1762166767.163230:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440048512 00000100:00100000:2.0:1762166767.163252:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 955 00000100:00100000:2.0:1762166767.163257:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+7:39815:x1847765440048512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166767.163264:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166767.163270:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b786 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a05 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.163284:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 8 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166767.163289:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166767.163290:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166767.163298:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b786 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a05 expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.163322:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 8 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166767.163332:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 8 pid: 9165 timeout: 486 lvb_type: 1 00000100:00100000:2.0:1762166767.163344:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446797696:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166767.163406:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166767.163474:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166767.163556:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440048640 00000100:00100000:2.0:1762166767.163560:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440048640 00000100:00100000:2.0:1762166767.163597:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 956 00000100:00100000:2.0:1762166767.163606:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440048640:12345-192.168.204.38@tcp:101:ll_agl.0 00010000:00010000:2.0:1762166767.163613:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166767.163622:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a0c expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166767.163667:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166767.163674:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166767.163675:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166767.163679:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 10 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166767.163687:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 10 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166767.163700:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac000, rc 0) 00000100:00100000:2.0:1762166767.163730:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440048640:12345-192.168.204.38@tcp:101:ll_agl.0 Request processed in 127us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.163734:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 956 00000100:00100000:2.0:1762166767.164246:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446797696:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166767.164266:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b786 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a05 expref: 9 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166767.164275:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad800, rc 0) 00000100:00100000:2.0:1762166767.164314:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:39815:x1847765440048512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1055us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.164320:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 955 00000100:00100000:1.0:1762166767.164612:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.164672:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440048768 00000100:00100000:0.0:1762166767.164681:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440048768 00010000:00010000:0.0:1762166767.164714:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 9 pid: 9165 timeout: 486 lvb_type: 1 00000100:00100000:0.0:1762166767.164753:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 624 00000100:00100000:0.0:1762166767.164763:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440048768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166767.164783:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166767.164813:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 9 pid: 9165 timeout: 486 lvb_type: 1 00010000:00010000:0.0:1762166767.164828:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 9 pid: 9165 timeout: 486 lvb_type: 1 00010000:00010000:0.0:1762166767.164851:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0b763 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f7 expref: 9 pid: 9165 timeout: 486 lvb_type: 1 00010000:00010000:0.0:1762166767.164867:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166767.164869:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166767.164885:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b786 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a05 expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.164895:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b786 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a05 expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.164930:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b786 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a05 expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166767.164944:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446797824:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166767.165005:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166767.165884:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446797824:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166767.165901:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166767.165935:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440048768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1173us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.165943:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 624 00000100:00100000:1.0:1762166767.167850:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.167891:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440049024 00000100:00100000:0.0:1762166767.167898:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440049024 00000100:00100000:0.0:1762166767.167939:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 756 00000100:00100000:0.0:1762166767.167948:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:39815:x1847765440049024:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166767.168162:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39815:x1847765440049024:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 216us (318us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1762166767.168168:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 756 00000100:00100000:1.0:1762166767.169563:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.169597:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440049280 00000100:00100000:0.0:1762166767.169604:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440049280 00000100:00100000:0.0:1762166767.169638:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 757 00000100:00100000:0.0:1762166767.169647:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:39815:x1847765440049280:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166767.169860:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39815:x1847765440049280:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 214us (298us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1762166767.169868:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 757 00000100:00100000:3.0:1762166767.176526:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.176603:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440049536 00000100:00100000:0.0:1762166767.176616:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440049536 00000100:00100000:0.0:1762166767.176690:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2632 00000100:00100000:0.0:1762166767.176702:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:39818:x1847765440049536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.176734:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.176757:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b794 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a13 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.176908:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b79b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.176924:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b79b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.176936:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b79b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166767.176948:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x2:0x0]: returning size 21 00010000:00010000:0.0:1762166767.177073:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b794 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a13 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.177093:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b79b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a13 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.177103:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:0.0:1762166767.177106:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166767.177127:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4600, rc 0) 00000100:00100000:0.0:1762166767.177194:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39818:x1847765440049536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 495us (680us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1762166767.177203:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2632 00000100:00100000:1.0:1762166767.179881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.179932:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440049664 00000100:00100000:0.0:1762166767.179943:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440049664 00000100:00100000:0.0:1762166767.179989:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2633 00000100:00100000:0.0:1762166767.179996:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39818:x1847765440049664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.180016:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.180032:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b7a9 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a1a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.180096:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.180107:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180116:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180251:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.180274:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180286:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180330:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180350:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180354:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180359:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180362:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.180365:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180369:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180378:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694600) 00010000:00010000:0.0:1762166767.180380:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.180383:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180386:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0b7b0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180397:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180401:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180404:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180407:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.180412:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180415:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180419:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180800) 00010000:00010000:0.0:1762166767.180420:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.180422:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180425:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b7b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.180458:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b7a9 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a1a expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.180464:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694600) 00010000:00010000:0.0:1762166767.180465:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.180468:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b7a9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a1a expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.180473:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4a00, rc 0) 00000100:00100000:0.0:1762166767.180565:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39818:x1847765440049664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 568us (694us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166767.180571:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2633 00000100:00100000:1.0:1762166767.182123:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.182179:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440049920 00000100:00100000:0.0:1762166767.182189:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440049920 00000100:00100000:0.0:1762166767.182240:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2634 00000100:00100000:0.0:1762166767.182252:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:39818:x1847765440049920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.182281:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.182285:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166767.182302:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b755 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79e9 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.182317:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694600) 00010000:00010000:0.0:1762166767.182325:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166767.182336:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b7be lrc: 2/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a21 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.182411:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.182420:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182427:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182437:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.182449:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182455:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182835:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.182844:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182861:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166767.182870:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x3:0x0]: returning size 0 00010000:00010000:0.0:1762166767.182892:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182899:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182905:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182911:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182915:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.182919:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182924:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182932:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4180100) 00010000:00010000:0.0:1762166767.182934:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.182937:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182943:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b7c5 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00010000:0.0:1762166767.182952:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b1cbf881 reply state 00000000cf191cdd transno 4294967422 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182973:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.182980:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:0.0:1762166767.182982:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166767.182985:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166767.183005:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b7be lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.183022:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.183029:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945bc4180b00) 00010000:00010000:0.0:1762166767.183031:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166767.183034:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4000, rc 0) 00000100:00100000:0.0:1762166767.183084:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:39818:x1847765440049920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 834us (964us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1762166767.183095:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2634 00000100:00100000:3.0:1762166767.184658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.184709:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440050176 00000100:00100000:0.0:1762166767.184717:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440050176 00000100:00100000:0.0:1762166767.184765:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2635 00000100:00100000:0.0:1762166767.184774:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:39818:x1847765440050176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.184792:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.184817:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0b7e1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a28 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.184881:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.184898:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.184904:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.184928:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.184937:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 17 pid: 6495 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1762166767.184948:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446797952:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166767.185018:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166767.185992:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446797952:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166767.186008:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166767.186175:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.186205:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440050304 00000100:00100000:0.0:1762166767.186209:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440050304 00010000:00010000:0.0:1762166767.186224:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 18 pid: 6495 timeout: 486 lvb_type: 0 00000100:00100000:0.0:1762166767.186250:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 625 00000100:00100000:0.0:1762166767.186259:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440050304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166767.186268:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166767.186273:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 18 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.186290:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 18 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.186306:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b7d3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a21 expref: 18 pid: 6495 timeout: 486 lvb_type: 0 00010000:00010000:0.0:1762166767.186318:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945bc4180b00) 00010000:00010000:0.0:1762166767.186323:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.186328:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.186332:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.186351:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166767.186377:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166767.186379:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440050304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 122us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166767.186393:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166767.186393:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 625 00000004:00200000:3.0:1762166767.186411:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x3:0x0]: returning size 0 00000004:00080000:3.0:1762166767.186621:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x15:0x0], index 0: 0 00000004:00080000:3.0:1762166767.186626:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x14:0x0], index 1: 0 00000004:00080000:3.0:1762166767.186629:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x16:0x0], index 0: 0 00000004:00080000:3.0:1762166767.186632:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x17:0x0], index 0: 0 00000004:00080000:3.0:1762166767.186634:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x15:0x0], index 1: 0 00000004:00080000:3.0:1762166767.186636:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x18:0x0], index 0: 0 00000004:00080000:3.0:1762166767.186638:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x16:0x0], index 1: 0 00010000:00010000:3.0:1762166767.186787:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.186793:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.186796:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.186823:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.186826:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.186831:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.186838:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945bc4180b00) 00010000:00010000:3.0:1762166767.186840:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166767.186843:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.186847:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0b7e8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166767.186873:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0b7e1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a28 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.186879:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945bc4180b00) 00010000:00010000:3.0:1762166767.186880:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166767.186883:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0b7e1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a28 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.186891:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4c00, rc 0) 00000100:00100000:3.0:1762166767.186917:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:39818:x1847765440050176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2145us (2267us total) trans 4294967423 rc 301/301 00000100:00100000:3.0:1762166767.186923:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2635 00000100:00100000:3.0:1762166767.188029:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.188071:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440050560 00000100:00100000:0.0:1762166767.188078:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440050560 00000100:00100000:0.0:1762166767.188117:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 758 00000100:00100000:0.0:1762166767.188125:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:39818:x1847765440050560:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166767.188307:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:39818:x1847765440050560:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 183us (278us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1762166767.188315:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 758 00000100:00100000:1.0:1762166767.189234:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.189269:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440050816 00000100:00100000:0.0:1762166767.189285:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440050816 00000100:00100000:0.0:1762166767.189318:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 759 00000100:00100000:0.0:1762166767.189334:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:39818:x1847765440050816:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166767.189470:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:39818:x1847765440050816:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 137us (236us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1762166767.189516:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 759 00000100:00100000:1.0:1762166767.201044:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166767.201081:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440051072 00000100:00100000:3.0:1762166767.201100:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440051072 00000100:00100000:3.0:1762166767.201145:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2636 00000100:00100000:3.0:1762166767.201152:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:39821:x1847765440051072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166767.201169:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166767.201184:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b7f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a2f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.201237:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201247:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201254:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201259:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201264:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201268:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201321:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201325:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201329:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201340:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201344:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.201346:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201351:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201362:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694b00) 00010000:00010000:3.0:1762166767.201365:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.201369:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201375:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b7fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201389:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201394:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201399:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201404:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166767.201406:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201411:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201428:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166767.201431:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166767.201434:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201439:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166767.201465:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b7f6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a2f expref: 16 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.201473:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694b00) 00010000:00010000:3.0:1762166767.201500:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166767.201505:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b7f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a2f expref: 16 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166767.201514:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6600, rc 0) 00000100:00100000:3.0:1762166767.201567:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:39821:x1847765440051072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 415us (529us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166767.201575:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2636 00000100:00100000:3.0:1762166767.202913:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.202964:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440051328 00000100:00100000:0.0:1762166767.202972:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440051328 00000100:00100000:0.0:1762166767.203007:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2637 00000100:00100000:0.0:1762166767.203015:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:39821:x1847765440051328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166767.203032:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166767.203048:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b80b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a36 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.203162:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b812 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.203172:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b812 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166767.203180:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b812 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166767.203189:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1762166767.203269:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0b80b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a36 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.203287:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b812 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a36 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166767.203306:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff945cd0738300) 00010000:00010000:0.0:1762166767.203310:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166767.203312:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4400, rc 0) 00000100:00100000:0.0:1762166767.203352:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:39821:x1847765440051328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 337us (442us total) trans 4294967426 rc 0/0 00000100:00100000:0.0:1762166767.203359:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2637 00000100:00100000:1.0:1762166767.204396:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166767.204446:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440051456 00000100:00100000:0.0:1762166767.204453:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440051456 00000100:00100000:0.0:1762166767.204522:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2638 00000100:00100000:0.0:1762166767.204533:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:39821:x1847765440051456:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166767.204575:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204586:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204594:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204603:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204610:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204617:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204665:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204680:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204687:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166767.204715:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1:0x0]: returning size 0 00000004:00200000:0.0:1762166767.204719:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166767.204727:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204739:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204745:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204750:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204756:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204761:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.204765:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204771:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204779:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694b00) 00010000:00010000:0.0:1762166767.204782:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.204786:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204815:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0b820 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204826:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204832:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204837:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204842:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.204845:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204850:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204857:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:0.0:1762166767.204860:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.204863:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204868:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b827 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204876:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204881:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204886:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204896:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166767.204899:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204905:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204912:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945bc4180c00) 00010000:00010000:0.0:1762166767.204914:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166767.204917:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166767.204922:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0b82e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166767.204974:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:39821:x1847765440051456:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 443us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166767.204982:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2638 00010000:00010000:1.0:1762166767.378644:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166767.378657:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166767.378663:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166767.378679:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446798080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166767.378679:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446798208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166767.378750:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166767.378777:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446798080 00000100:00100000:0.0:1762166767.378785:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446798080 00000100:00100000:2.0:1762166767.378828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1762166767.378864:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166767.378865:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446798208 00000100:00100000:0.0:1762166767.378870:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446798208 00000100:00100000:1.0:1762166767.378882:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1762166767.378892:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1762166767.378895:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446798080:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1762166767.378906:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446798208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1762166767.378928:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3922432000 avail 3690909696 00002000:00000024:1.0:1762166767.378928:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3922432000 avail 3690909696 00000100:00100000:2.0:1762166767.378989:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446798208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166767.378992:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446798080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166767.379002:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1762166767.379020:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1762166767.379041:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446798080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166767.379041:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446798208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166768.402667:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1847765446798720:0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.402668:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446798336:0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.402725:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446798592:0@lo:400:kworker.0 00000100:00100000:3.0:1762166768.402744:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166768.402750:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166768.402807:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166768.402825:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446798336 00000100:00100000:2.0:1762166768.402835:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446798336 00000100:00100000:3.0:1762166768.402839:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446799232:0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.402840:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446799104:0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.402841:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446798848:0@lo:400:kworker.0 00000100:00100000:3.0:1762166768.402889:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166768.402889:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1762166768.402901:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166768.402903:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446798336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166768.402933:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1847765446799744:0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.402939:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446799360:0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.402947:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166768.402984:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446799616:0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.402994:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166768.403000:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446798336:12345-0@lo:400:kworker.0 Request processed in 99us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166768.403002:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166768.403013:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1762166768.403014:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1847765446798464:0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.403026:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446799872:0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403041:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166768.403066:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446798976:0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403068:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446798720 00000100:00100000:0.0:1762166768.403071:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166768.403074:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446798720 00000100:00100000:3.0:1762166768.403075:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446798592 00000100:00100000:3.0:1762166768.403081:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446798592 00000100:00100000:1.0:1762166768.403100:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166768.403106:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446799744 00000100:00100000:2.0:1762166768.403110:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446799744 00000100:00100000:0.0:1762166768.403117:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446798336:0@lo:400:kworker.0 00000100:00100000:3.0:1762166768.403122:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446798848 00000100:00100000:3.0:1762166768.403127:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446798848 00000100:00100000:1.0:1762166768.403130:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1847765446799488:0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403137:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446798464 00000100:00100000:2.0:1762166768.403140:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446798464 00000100:00100000:2.0:1762166768.403161:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446799872 00000100:00100000:3.0:1762166768.403163:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1762166768.403163:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166768.403164:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446799872 00000100:00100000:0.0:1762166768.403175:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1762166768.403180:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446798592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403181:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446799488 00000100:00100000:2.0:1762166768.403185:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446799488 00000100:00100000:0.0:1762166768.403190:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446798848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403199:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446799232 00000100:00100000:1.0:1762166768.403203:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446799232 00000100:00100000:2.0:1762166768.403209:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1762166768.403216:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1847765446798720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403235:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446799104 00000100:00100000:3.0:1762166768.403236:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446798592:12345-0@lo:400:kworker.0 Request processed in 60us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166768.403239:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446799104 00000100:00100000:3.0:1762166768.403248:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1762166768.403252:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446798848:12345-0@lo:400:kworker.0 Request processed in 65us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166768.403260:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1847765446798720:12345-0@lo:400:kworker.0 Request processed in 43us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166768.403262:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446799360 00000100:00100000:1.0:1762166768.403266:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446799360 00000100:00100000:0.0:1762166768.403266:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1762166768.403272:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1762166768.403289:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446798976 00000100:00100000:1.0:1762166768.403292:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446798976 00000100:00100000:2.0:1762166768.403296:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1762166768.403302:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1847765446798720:0@lo:400:kworker.0 00010000:00010000:0.0:1762166768.403304:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166768.403309:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1847765446799744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403310:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1762166768.403322:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446799232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.403326:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1762166768.403338:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446799104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166768.403342:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1762166768.403357:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446799360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403370:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1847765446799744:12345-0@lo:400:kworker.0 Request processed in 66us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166768.403372:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446799232:12345-0@lo:400:kworker.0 Request processed in 52us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166768.403387:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446799232:0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403390:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1762166768.403390:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1762166768.403392:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446799104:12345-0@lo:400:kworker.0 Request processed in 53us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166768.403405:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1762166768.403412:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1847765446799744:0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403419:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1762166768.403420:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1762166768.403438:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1847765446798464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403443:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446798976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.403445:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1762166768.403460:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446799872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166768.403502:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446799360:12345-0@lo:400:kworker.0 Request processed in 150us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166768.403510:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1762166768.403514:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446798976:12345-0@lo:400:kworker.0 Request processed in 84us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166768.403521:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1762166768.403527:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1847765446798464:12345-0@lo:400:kworker.0 Request processed in 95us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166768.403535:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1762166768.403544:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446799872:12345-0@lo:400:kworker.0 Request processed in 85us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166768.403553:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1762166768.403560:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1762166768.403577:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1847765446799488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403588:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166768.403594:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967415 gen 2 00000004:00080000:0.0:1762166768.403601:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967415 committed transno 4294967415 00000100:00100000:3.0:1762166768.403611:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446799616 00000100:00100000:2.0:1762166768.403616:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1847765446799488:12345-0@lo:400:kworker.0 Request processed in 42us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166768.403621:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446799616 00000100:00100000:2.0:1762166768.403627:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1762166768.403630:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446798848:0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403633:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446798592:0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403651:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1762166768.403659:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446799104:0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.403662:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446799360:0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403665:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446799616:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1762166768.403678:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1762166768.403685:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166768.403689:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446799872:0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403699:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1847765446798464:0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.403717:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446798976:0@lo:400:kworker.0 00000100:00100000:2.0:1762166768.403719:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446799616:12345-0@lo:400:kworker.0 Request processed in 59us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166768.403729:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1762166768.403735:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1847765446799488:0@lo:400:kworker.0 00000100:00100000:0.0:1762166768.403751:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446799616:0@lo:400:kworker.0 00000100:00100000:1.0:1762166768.908966:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166768.909010:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166768.909027:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440051584 00000100:00100000:0.0:1762166768.909040:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440051584 00000100:00100000:1.0:1762166768.909048:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166768.909078:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440051712 00000100:00100000:2.0:1762166768.909086:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440051712 00000100:00100000:1.0:1762166768.909087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166768.909090:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440051968 00000100:00100000:3.0:1762166768.909095:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440051968 00000100:00100000:0.0:1762166768.909105:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 596 00000100:00100000:0.0:1762166768.909117:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2418:x1847765440051584:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166768.909129:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440051840 00000100:00100000:3.0:1762166768.909132:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:2.0:1762166768.909133:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440051840 00000100:00100000:3.0:1762166768.909142:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440051968:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166768.909146:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166768.909157:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 384 00000100:00100000:2.0:1762166768.909165:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440051712:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166768.909176:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2418:x1847765440051584:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 62us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166768.909182:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 596 00000100:00100000:3.0:1762166768.909191:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440051968:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166768.909192:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440051712:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 28us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166768.909201:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:2.0:1762166768.909201:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 384 00000100:00100000:3.0:1762166768.909219:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440052096 00000100:00100000:2.0:1762166768.909221:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 385 00000100:00100000:3.0:1762166768.909223:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440052096 00000100:00100000:2.0:1762166768.909229:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440051840:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:0.0:1762166768.909250:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166768.909255:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166768.909261:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 233 00000100:00100000:2.0:1762166768.909261:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440051840:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166768.909268:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 385 00000100:00100000:3.0:1762166768.909271:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+6:2418:x1847765440052096:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166768.909305:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+6:2418:x1847765440052096:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166768.909367:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 233 00000001:00080000:0.0:1762166768.915852:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836663 is committed 00000001:00100000:0.0:1762166768.915866:0:24624:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1e11365-ba0b-405b-99c9-a704373217f2 00000001:00100000:0.0:1762166768.915873:0:24624:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd0f52a9-204e-4869-b8da-3af938f6f960 00000001:00080000:1.0:1762166768.915877:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869351 is committed 00000001:00080000:0.0:1762166768.915881:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836661 is committed 00000020:00000080:0.0:1762166768.915886:0:24624:0:(genops.c:904:class_export_put()) final put ffff945bc81f6000/fd0f52a9-204e-4869-b8da-3af938f6f960 00000001:00080000:1.0:1762166768.915887:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869350 is committed 00000001:00100000:1.0:1762166768.915894:0:25941:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1e11365-ba0b-405b-99c9-a704373217f2 00000001:00100000:1.0:1762166768.915899:0:25941:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd0f52a9-204e-4869-b8da-3af938f6f960 00000001:00080000:1.0:1762166768.915905:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869348 is committed 00000020:00000080:1.0:1762166768.915926:0:25941:0:(genops.c:904:class_export_put()) final put ffff945cc7d3d800/fd0f52a9-204e-4869-b8da-3af938f6f960 00000020:00000080:2.0:1762166768.915941:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc81f6000/fd0f52a9-204e-4869-b8da-3af938f6f960 for lustre-OST0000 00000020:00000080:2.0:1762166768.915989:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff945cc7d3d800/fd0f52a9-204e-4869-b8da-3af938f6f960 for lustre-OST0001 00000020:00000080:2.0:1762166768.916026:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc81f4800 for lustre-OST0000 00000020:00000080:2.0:1762166768.916031:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cc7d39800 for lustre-OST0001 00010000:00010000:1.0:1762166769.426663:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166769.590429:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166769.590541:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440052352 00000100:00100000:1.0:1762166769.590554:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440052352 00000100:00080000:0.0:1762166769.590635:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166769.590665:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2639 00000100:00100000:1.0:1762166769.590675:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:40524:x1847765440052352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166769.590698:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166769.590726:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0b835 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a3d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166769.590826:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166769.590839:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590848:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590856:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166769.590860:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590864:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590947:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590955:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590961:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590967:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590982:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166769.590988:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.590995:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591008:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945cc29d3e00) 00010000:00010000:1.0:1762166769.591010:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166769.591014:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591019:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0b83c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591031:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591035:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591038:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591041:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166769.591042:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591045:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591049:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:1.0:1762166769.591050:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166769.591056:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591060:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0b843 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.591084:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0b835 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a3d expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166769.591094:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945cc29d3e00) 00010000:00010000:1.0:1762166769.591096:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166769.591100:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0b835 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a3d expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166769.591115:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:1.0:1762166769.591194:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:40524:x1847765440052352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 519us (775us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166769.591202:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2639 00000100:00100000:3.0:1762166769.592243:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166769.592282:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440052480 00000100:00100000:1.0:1762166769.592289:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440052480 00000100:00100000:1.0:1762166769.592324:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2640 00000100:00100000:1.0:1762166769.592333:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:40524:x1847765440052480:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166769.592401:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166769.592413:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592423:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592440:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166769.592445:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592449:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592518:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166769.592523:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592527:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166769.592572:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x3:0x0]: returning size 0 00000004:00200000:1.0:1762166769.592575:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166769.592586:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592604:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592610:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592616:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592623:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592638:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166769.592647:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592653:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592663:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945cc29d3d00) 00010000:00010000:1.0:1762166769.592667:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166769.592670:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 3/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592677:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b84a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592691:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592695:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592698:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592701:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166769.592703:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592706:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592710:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:1.0:1762166769.592711:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166769.592718:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592722:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b851 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592729:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592732:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592735:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592738:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166769.592740:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592743:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592746:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166769.592747:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166769.592749:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166769.592752:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b858 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166769.592812:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:40524:x1847765440052480:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 481us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166769.592817:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2640 00000100:00100000:0.0:1762166769.938717:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1762166769.938742:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446800128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166769.938819:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166769.938869:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446800128 00000100:00100000:1.0:1762166769.938890:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446800128 00000100:00100000:0.0:1762166769.938900:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446800000:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1762166769.938940:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166769.938948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166769.938969:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446800000 00000100:00100000:1.0:1762166769.938976:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446800000 00000100:00100000:3.0:1762166769.939016:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1762166769.939044:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446800128:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1762166769.939048:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166769.939058:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1762166769.939076:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446800000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1762166769.939097:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00002000:00000024:3.0:1762166769.939098:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1762166769.939190:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446800000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166769.939195:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446800128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166769.939201:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1762166769.939212:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1762166769.939235:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869350 gen 2 00000004:00080000:0.0:1762166769.939243:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe35c00, transno 17179869347 00000004:00080000:0.0:1762166769.939258:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf7838700, transno 17179869349 00000004:00080000:0.0:1762166769.939261:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe33480, transno 17179869350 00000100:00100000:0.0:1762166769.939281:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446800128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166769.939308:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869351 gen 2 00000004:00080000:0.0:1762166769.939311:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4013b80, transno 17179869351 00000100:00100000:0.0:1762166769.939326:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446800000:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1762166769.939415:0:10004:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:1.0:1762166770.450638:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166770.450693:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446800256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166770.450792:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166770.450861:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446800256 00000100:00100000:2.0:1762166770.450872:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446800256 00000100:00100000:2.0:1762166770.450933:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1762166770.450945:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446800256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1762166770.450988:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445986304 avail 1299746816 00000100:00100000:2.0:1762166770.451045:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446800256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166770.451053:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1762166770.451099:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446800256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166770.962677:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446800384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166770.962758:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166770.962798:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446800384 00000100:00100000:2.0:1762166770.962805:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446800384 00000100:00100000:2.0:1762166770.962861:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1762166770.962871:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446800384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1762166770.962911:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446236160 avail 1299996672 00000100:00100000:2.0:1762166770.962960:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446800384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166770.962968:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1762166770.963007:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446800384:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1762166771.474655:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166771.968327:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166771.968400:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440052608 00000100:00100000:1.0:1762166771.968408:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440052608 00000100:00100000:1.0:1762166771.968465:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2641 00000100:00080000:0.0:1762166771.968471:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166771.968504:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:41226:x1847765440052608:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1762166771.968523:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166771.968539:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b85f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a44 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.968585:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968595:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968603:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968609:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968613:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968617:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968669:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0b874 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968673:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0b874 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968688:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0b874 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166771.968730:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1:0x0]: returning size 0 00000004:00200000:1.0:1762166771.968734:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166771.968748:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0b874 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968756:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0b874 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968762:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968766:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968770:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968774:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968777:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166771.968779:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968783:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968790:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694b00) 00010000:00010000:1.0:1762166771.968792:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166771.968795:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968807:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0b866 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968816:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968820:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968823:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968826:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166771.968827:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968830:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968834:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:1.0:1762166771.968835:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166771.968837:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968839:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0b86d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.968855:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0b85f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a44 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.968863:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0b874 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a44 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.968874:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945bc4180c00) 00010000:00010000:1.0:1762166771.968876:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166771.968877:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:1.0:1762166771.968924:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:41226:x1847765440052608:12345-192.168.204.38@tcp:101:rm.0 Request processed in 452us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166771.968929:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2641 00000100:00100000:0.0:1762166771.969932:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166771.969984:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440052736 00000100:00100000:2.0:1762166771.969994:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440052736 00000100:00100000:2.0:1762166771.970023:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 280 00000100:00100000:2.0:1762166771.970028:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440052736:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166771.970036:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166771.970047:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0b874 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a44 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166771.970056:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945bc4180c00) 00010000:00010000:2.0:1762166771.970059:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166771.970081:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440052736:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166771.970085:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 280 00000100:00100000:3.0:1762166771.970540:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166771.970575:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440052992 00000100:00100000:1.0:1762166771.970581:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440052992 00000100:00100000:1.0:1762166771.970611:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2642 00000100:00100000:1.0:1762166771.970619:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:41226:x1847765440052992:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:1.0:1762166771.970649:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166771.970660:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0b77f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79fe expref: 15 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.970671:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945bc4180c00) 00010000:00010000:1.0:1762166771.970684:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b75c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79f0 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.970690:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694b00) 00010000:00010000:1.0:1762166771.970694:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166771.970705:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.970723:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.970729:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.970740:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.970744:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.970748:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.970781:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.970785:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.970789:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000040:00080000:1.0:1762166771.970963:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].108, 64 off16952 00000004:00080000:1.0:1762166771.970972:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391119493978ns, next at 392119491660ns, rc = 0 00000040:00080000:1.0:1762166771.970993:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].104, 64 off16600 00000004:00080000:1.0:1762166771.971000:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391119522073ns, next at 392119520479ns, rc = 0 00000040:00080000:1.0:1762166771.971010:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].109, 64 off17016 00000040:00080000:1.0:1762166771.971015:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].110, 64 off17080 00000040:00080000:1.0:1762166771.971020:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].105, 64 off16664 00000040:00080000:1.0:1762166771.971024:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].111, 64 off17144 00000040:00080000:1.0:1762166771.971029:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].106, 64 off16728 00010000:00010000:1.0:1762166771.971064:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971070:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971081:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971086:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971089:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971092:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971109:0:6494:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166771.971118:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971121:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971124:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971128:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166771.971130:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971133:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.971135:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166771.971138:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945cd0738200) 00010000:00010000:1.0:1762166771.971141:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762166771.971144:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.971145:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.971161:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166771.971162:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0b889 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.971167:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.971176:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.971186:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1:0x0].0x0 (ffff945cd0738200) 00010000:00010000:2.0:1762166771.971189:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166771.971193:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.971198:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0b890 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.971222:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166771.971224:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166771.971227:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166771.971298:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971303:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971306:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971309:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971312:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166771.971314:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971317:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971322:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166771.971324:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166771.971326:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 3/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971331:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0b87b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166771.971343:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000d39e99d reply state 00000000d05521c4 transno 4294968884 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971352:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.971364:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:1.0:1762166771.971367:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166771.971369:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166771.971407:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:41226:x1847765440052992:12345-192.168.204.38@tcp:36:rm.0 Request processed in 790us (869us total) trans 4294968884 rc 0/0 00000100:00100000:1.0:1762166771.971412:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2642 00000100:00100000:1.0:1762166771.972415:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.972461:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440053120 00000100:00100000:3.0:1762166771.972468:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440053120 00000100:00100000:3.0:1762166771.972531:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2643 00000100:00080000:0.0:1762166771.972538:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1762166771.972549:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:41226:x1847765440053120:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166771.972561:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.972575:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b897 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a4b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.972615:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.972624:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972633:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972643:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.972650:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972656:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972700:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8ac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.972708:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972728:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166771.972756:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x3:0x0]: returning size 0 00000004:00200000:3.0:1762166771.972761:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166771.972785:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972795:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972802:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972808:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972814:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972818:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972824:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.972827:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972832:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972840:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694700) 00010000:00010000:3.0:1762166771.972843:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.972846:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 3/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972851:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0b89e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972861:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972875:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972881:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972886:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.972888:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972894:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972901:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:3.0:1762166771.972903:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.972906:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972912:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.972931:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0b897 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a4b expref: 22 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.972945:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a4b expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.972952:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945bc4694d00) 00010000:00010000:3.0:1762166771.972954:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166771.972957:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6a00, rc 0) 00000100:00100000:3.0:1762166771.972991:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:41226:x1847765440053120:12345-192.168.204.38@tcp:101:rm.0 Request processed in 446us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166771.973004:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2643 00000100:00100000:0.0:1762166771.973848:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.973882:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440053248 00000100:00100000:3.0:1762166771.973887:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440053248 00000100:00080000:0.0:1762166771.973929:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166771.973962:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 957 00000100:00100000:3.0:1762166771.973971:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+7:2419:x1847765440053248:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166771.973980:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.973991:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a52 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166771.974063:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166771.974076:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166771.974078:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166771.974086:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 8 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166771.974100:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 8 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166771.974110:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7e00, rc 0) 00000100:00100000:3.0:1762166771.974141:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440053248:12345-192.168.204.38@tcp:101:rm.0 Request processed in 172us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166771.974148:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 957 00000100:00100000:0.0:1762166771.975039:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.975075:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440053504 00000100:00100000:3.0:1762166771.975080:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440053504 00000100:00100000:3.0:1762166771.975111:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2644 00000100:00100000:3.0:1762166771.975118:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:41226:x1847765440053504:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:3.0:1762166771.975155:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166771.975167:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8ac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a4b expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.975180:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945bc4694d00) 00010000:00010000:3.0:1762166771.975186:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166771.975197:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.975206:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975212:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975221:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.975228:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975235:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975272:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.975279:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975286:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:3.0:1762166771.975461:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off9040 00000004:00080000:3.0:1762166771.975503:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 391124024836ns, next at 392123996765ns, rc = 0 00000040:00080000:3.0:1762166771.975531:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].9, 64 off8840 00000004:00080000:3.0:1762166771.975537:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 391124059532ns, next at 392124057916ns, rc = 0 00000040:00080000:3.0:1762166771.975548:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off9104 00000040:00080000:3.0:1762166771.975557:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9168 00000040:00080000:3.0:1762166771.975565:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].10, 64 off8904 00000040:00080000:3.0:1762166771.975574:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9232 00000040:00080000:3.0:1762166771.975582:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].11, 64 off8968 00010000:00010000:3.0:1762166771.975622:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 3/0,1 mode: --/PW res: [0x240000404:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.975631:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975637:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975643:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975649:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975654:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975673:0:6494:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166771.975683:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975690:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975697:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166771.975704:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166771.975721:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166771.975722:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975728:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166771.975734:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166771.975739:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166771.975741:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975760:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945bc4694400) 00010000:00010000:0.0:1762166771.975760:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975765:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1762166771.975770:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166771.975776:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x3:0x0].0x0 (ffff945bc4694400) 00010000:00010000:3.0:1762166771.975779:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0b8c8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166771.975780:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166771.975784:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 1/0,0 mode: --/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166771.975791:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0b8cf lrc: 0/0,0 mode: --/PW res: [0x240000404:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166771.975804:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166771.975805:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166771.975806:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166771.975911:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975919:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975924:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975930:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975935:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.975938:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975944:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975961:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694f00) 00010000:00010000:3.0:1762166771.975964:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.975967:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975972:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7200/0x2f180c4effb0b8ba lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166771.975983:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c85f0825 reply state 00000000f2563ce1 transno 4294967427 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975993:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.975999:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:3.0:1762166771.976001:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166771.976003:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166771.976043:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:41226:x1847765440053504:12345-192.168.204.38@tcp:36:rm.0 Request processed in 925us (1005us total) trans 4294967427 rc 0/0 00000100:00100000:3.0:1762166771.976051:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2644 00000100:00100000:1.0:1762166771.981406:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.981449:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440053632 00000100:00100000:3.0:1762166771.981460:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440053632 00000100:00100000:3.0:1762166771.981534:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2645 00000100:00100000:3.0:1762166771.981546:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:41227:x1847765440053632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166771.981566:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.981583:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a59 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.981634:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981656:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981666:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981677:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981685:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981691:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981740:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981747:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981753:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981760:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981765:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.981769:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981776:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981796:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694d00) 00010000:00010000:3.0:1762166771.981799:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.981803:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981809:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0b8dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981819:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981825:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981831:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981836:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.981839:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981844:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981850:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166771.981852:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.981855:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981860:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0b8e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.981881:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8d6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a59 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.981894:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694d00) 00010000:00010000:3.0:1762166771.981897:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.981900:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0b8d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a59 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.981917:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6a00, rc 0) 00000100:00100000:3.0:1762166771.981960:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:41227:x1847765440053632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 418us (561us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166771.981965:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2645 00000100:00100000:0.0:1762166771.982855:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.982887:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440053760 00000100:00100000:3.0:1762166771.982893:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440053760 00000100:00100000:3.0:1762166771.982924:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2646 00000100:00100000:3.0:1762166771.982931:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:41227:x1847765440053760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166771.982940:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.982949:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b8eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a60 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.982978:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.982986:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.982993:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983001:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983017:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983024:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983040:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983046:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983052:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983058:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983063:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.983066:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983071:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983078:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694700) 00010000:00010000:3.0:1762166771.983080:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.983083:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983089:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0b8f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983098:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983109:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983115:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983120:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.983123:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983128:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983136:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166771.983138:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.983140:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983146:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0b8f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.983166:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b8eb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a60 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.983174:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694700) 00010000:00010000:3.0:1762166771.983176:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.983180:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0b8eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a60 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.983190:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7600, rc 0) 00000100:00100000:3.0:1762166771.983222:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:41227:x1847765440053760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 290us (367us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166771.983235:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2646 00000100:00100000:0.0:1762166771.984042:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.984072:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440053888 00000100:00100000:3.0:1762166771.984077:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440053888 00000100:00100000:3.0:1762166771.984105:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2647 00000100:00100000:3.0:1762166771.984113:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:41227:x1847765440053888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166771.984124:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.984135:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b900 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a67 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.984164:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7000/0x2f180c4effb0b907 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.984171:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7000/0x2f180c4effb0b907 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.984178:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7000/0x2f180c4effb0b907 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166771.984213:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1762166771.984216:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1762166771.984235:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0b900 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a67 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.984243:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7000/0x2f180c4effb0b907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a67 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.984248:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694800) 00010000:00010000:3.0:1762166771.984249:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166771.984251:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7000, rc 0) 00000100:00100000:3.0:1762166771.984279:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:41227:x1847765440053888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 168us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166771.984283:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2647 00000100:00100000:1.0:1762166771.984973:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.984999:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440054016 00000100:00100000:3.0:1762166771.985003:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440054016 00000100:00100000:3.0:1762166771.985023:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2648 00000100:00100000:3.0:1762166771.985029:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:41227:x1847765440054016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166771.985035:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.985042:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b90e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a6e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.985061:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.985066:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.985071:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166771.985086:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1762166771.985088:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1762166771.985100:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0b90e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a6e expref: 17 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.985108:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a6e expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.985112:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694e00) 00010000:00010000:3.0:1762166771.985113:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166771.985119:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7800, rc 0) 00000100:00100000:3.0:1762166771.985141:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:41227:x1847765440054016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 113us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166771.985146:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2648 00000100:00100000:0.0:1762166771.987144:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.987169:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440054144 00000100:00100000:3.0:1762166771.987174:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440054144 00000100:00100000:3.0:1762166771.987196:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2649 00000100:00100000:3.0:1762166771.987200:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:41227:x1847765440054144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166771.987207:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.987214:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b91c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a75 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.987239:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987245:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987250:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987255:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987259:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987263:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987279:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987290:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987294:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987297:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987300:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.987302:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987306:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987312:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694e00) 00010000:00010000:3.0:1762166771.987314:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.987316:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987319:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0b923 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987325:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987328:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987331:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987334:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.987339:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987342:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987346:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166771.987348:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.987349:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987352:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0b92a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.987364:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b91c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a75 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.987369:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694e00) 00010000:00010000:3.0:1762166771.987370:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.987372:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0b91c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a75 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.987377:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6e00, rc 0) 00000100:00100000:3.0:1762166771.987402:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:41227:x1847765440054144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 201us (260us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166771.987406:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2649 00000100:00100000:0.0:1762166771.988432:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.988467:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440054400 00000100:00100000:3.0:1762166771.988472:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440054400 00000100:00100000:3.0:1762166771.988515:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2650 00000100:00100000:3.0:1762166771.988522:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:41227:x1847765440054400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166771.988535:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.988537:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166771.988547:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0b915 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a6e expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.988559:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694e00) 00010000:00010000:3.0:1762166771.988566:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166771.988575:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b931 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a7c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.988618:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.988626:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.988633:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.988640:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.988647:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.988652:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.988956:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.988964:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.988980:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166771.988988:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2:0x0]: returning size 0 00010000:00010000:3.0:1762166771.989007:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989011:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989014:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989018:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989020:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.989022:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989025:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989030:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694100) 00010000:00010000:3.0:1762166771.989031:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166771.989033:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989036:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0b938 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000004:00010000:3.0:1762166771.989042:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cf335bbd reply state 00000000b8660933 transno 4294968885 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989056:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.989060:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166771.989061:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166771.989063:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166771.989077:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0b931 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 18 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.989086:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 17 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.989090:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2:0x0].0x0 (ffff945bc4694a00) 00010000:00010000:3.0:1762166771.989091:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166771.989092:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:3.0:1762166771.989119:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:41227:x1847765440054400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 599us (689us total) trans 4294968885 rc 0/0 00000100:00100000:3.0:1762166771.989123:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2650 00000100:00100000:1.0:1762166771.990212:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.990258:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440054656 00000100:00100000:3.0:1762166771.990264:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440054656 00000100:00100000:3.0:1762166771.990295:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2651 00000100:00100000:3.0:1762166771.990304:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:41227:x1847765440054656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166771.990318:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.990328:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b954 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a83 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.990379:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.990400:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 19 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.990407:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.990439:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 19 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.990451:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 19 pid: 6494 timeout: 491 lvb_type: 0 00000100:00100000:3.0:1762166771.990465:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446800512:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166771.990541:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166771.991170:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446800512:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166771.991181:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166771.991399:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166771.991443:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440054784 00000100:00100000:2.0:1762166771.991448:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440054784 00010000:00010000:2.0:1762166771.991468:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 20 pid: 6494 timeout: 491 lvb_type: 0 00000100:00100000:2.0:1762166771.991519:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 626 00000100:00100000:2.0:1762166771.991529:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440054784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166771.991538:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166771.991544:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 20 pid: 6494 timeout: 491 lvb_type: 0 00010000:00010000:2.0:1762166771.991555:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 20 pid: 6494 timeout: 491 lvb_type: 0 00010000:00010000:2.0:1762166771.991568:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b946 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a7c expref: 20 pid: 6494 timeout: 491 lvb_type: 0 00010000:00010000:2.0:1762166771.991578:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2:0x0].0x0 (ffff945bc4694a00) 00010000:00010000:2.0:1762166771.991582:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.991588:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.991594:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166771.991624:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166771.991639:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.991645:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166771.991654:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2:0x0]: returning size 0 00000100:00100000:2.0:1762166771.991655:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440054784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166771.991665:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 626 00000004:00080000:3.0:1762166771.991775:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x44:0x0], index 0: 0 00000004:00080000:3.0:1762166771.991783:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x40:0x0], index 1: 0 00000004:00080000:3.0:1762166771.991785:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x45:0x0], index 0: 0 00000004:00080000:3.0:1762166771.991830:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x46:0x0], index 0: 0 00000004:00080000:3.0:1762166771.991842:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x41:0x0], index 1: 0 00000004:00080000:3.0:1762166771.991848:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x47:0x0], index 0: 0 00000004:00080000:3.0:1762166771.991852:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:3.0:1762166771.991984:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.991989:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.991993:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.991996:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166771.991998:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.992001:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.992006:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2:0x0].0x0 (ffff945bc4694a00) 00010000:00010000:3.0:1762166771.992008:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166771.992010:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.992013:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b95b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.992034:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b954 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a83 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.992039:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2:0x0].0x0 (ffff945bc4694a00) 00010000:00010000:3.0:1762166771.992040:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166771.992047:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b954 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a83 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.992055:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a200, rc 0) 00000100:00100000:3.0:1762166771.992081:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:41227:x1847765440054656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1780us (1870us total) trans 4294968886 rc 301/301 00000100:00100000:3.0:1762166771.992086:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2651 00000100:00100000:1.0:1762166771.992897:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166771.992937:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440055040 00000100:00100000:0.0:1762166771.992942:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440055040 00000100:00100000:0.0:1762166771.992973:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 760 00000100:00100000:0.0:1762166771.992980:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:41227:x1847765440055040:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166771.993121:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:41227:x1847765440055040:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 141us (224us total) trans 4294968887 rc 0/0 00000100:00100000:0.0:1762166771.993126:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 760 00000100:00100000:0.0:1762166771.993723:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166771.993754:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440055296 00000100:00100000:2.0:1762166771.993758:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440055296 00000100:00100000:2.0:1762166771.993789:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 761 00000100:00100000:2.0:1762166771.993797:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:41227:x1847765440055296:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166771.993878:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:41227:x1847765440055296:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 83us (167us total) trans 4294968888 rc 0/0 00000100:00100000:2.0:1762166771.993884:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 761 00000100:00100000:3.0:1762166771.996673:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166771.996751:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440055552 00000100:00100000:1.0:1762166771.996758:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440055552 00000100:00100000:1.0:1762166771.996795:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2652 00000100:00100000:1.0:1762166771.996801:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:41228:x1847765440055552:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1762166771.996814:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166771.996817:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166771.996834:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0b708 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79d4 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.996846:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:1.0:1762166771.996850:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166771.996858:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b969 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.996927:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b970 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166771.996947:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b970 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166771.996952:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b970 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166771.996961:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x2:0x0]: returning size 21 00010000:00010000:1.0:1762166771.997026:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0b969 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a8a expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.997035:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b970 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a8a expref: 24 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166771.997040:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:1.0:1762166771.997041:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166771.997043:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0800, rc 0) 00000100:00100000:1.0:1762166771.997078:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:41228:x1847765440055552:12345-192.168.204.38@tcp:101:bash.0 Request processed in 278us (409us total) trans 4294967428 rc 0/0 00000100:00100000:1.0:1762166771.997083:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2652 00000100:00100000:1.0:1762166771.997905:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.997930:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440055680 00000100:00100000:3.0:1762166771.997934:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440055680 00000100:00100000:3.0:1762166771.997958:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2653 00000100:00100000:3.0:1762166771.997964:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:41228:x1847765440055680:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:3.0:1762166771.997973:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166771.997979:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0b97e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a91 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.997992:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0b985 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.997998:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0b985 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.998003:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0b985 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.998065:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0b97e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a91 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.998077:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0b985 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a91 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.998092:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:3.0:1762166771.998095:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166771.998097:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b000, rc 0) 00000100:00100000:3.0:1762166771.998133:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:41228:x1847765440055680:12345-192.168.204.38@tcp:101:bash.0 Request processed in 169us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166771.998139:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2653 00000100:00100000:0.0:1762166771.998835:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166771.998861:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440055936 00000100:00100000:3.0:1762166771.998866:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440055936 00000100:00100000:3.0:1762166771.998894:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2654 00000100:00100000:3.0:1762166771.998901:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:41228:x1847765440055936:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:3.0:1762166771.998924:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166771.998935:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0b970 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a8a expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166771.998946:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:3.0:1762166771.998950:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166771.999045:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166771.999055:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.999062:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:3.0:1762166771.999094:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967429 00000004:00010000:3.0:1762166771.999112:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000096f3ba87 reply state 00000000b663267b transno 4294967430 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.999139:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166771.999145:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:3.0:1762166771.999148:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166771.999150:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166771.999199:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:41228:x1847765440055936:12345-192.168.204.38@tcp:36:bash.0 Request processed in 297us (368us total) trans 4294967430 rc 0/0 00000100:00100000:3.0:1762166771.999206:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2654 00000020:00080000:3.0:1762166771.999210:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166771.999969:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166771.999999:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440056064 00000100:00100000:1.0:1762166772.000003:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440056064 00002000:00010000:1.0:1762166772.000020:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/20 (0->18446744073709551615) 00002000:00100000:1.0:1762166772.000024:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783ed80 with x1847765440056064 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166772.000030:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783ed80. 00000100:00100000:1.0:1762166772.000046:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 463 00000100:00100000:1.0:1762166772.000051:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440056064:12345-192.168.204.38@tcp:10:bash.0 00002000:00010000:1.0:1762166772.000152:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166772.000161:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1762166772 00002000:00010000:1.0:1762166772.000162:0:16567:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166772.000164:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1762166772 00002000:00010000:1.0:1762166772.000165:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166772.000189:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440056064:12345-192.168.204.38@tcp:10:bash.0 Request processed in 138us (221us total) trans 21474836664 rc 0/0 00000100:00100000:1.0:1762166772.000194:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 463 00002000:00010000:1.0:1762166772.000196:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/20 (0->18446744073709551615) 00002000:00100000:1.0:1762166772.000198:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783ed80 with x1847765440056064 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166772.000201:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783ed80. 00000100:00100000:1.0:1762166772.005741:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.005790:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440056320 00000100:00100000:3.0:1762166772.005799:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440056320 00000100:00100000:3.0:1762166772.005844:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2655 00000100:00100000:3.0:1762166772.005855:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:41228:x1847765440056320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166772.005877:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166772.005897:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0b993 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a98 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.005959:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.005972:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.005982:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.005992:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.005998:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006015:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006078:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006085:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006090:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006096:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006102:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.006107:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006113:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006124:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694a00) 00010000:00010000:3.0:1762166772.006126:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.006130:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006136:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0b99a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006147:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006152:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006162:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006165:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.006167:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006170:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006175:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166772.006176:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.006178:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006181:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0b9a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.006200:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0b993 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a98 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.006206:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694a00) 00010000:00010000:3.0:1762166772.006207:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166772.006209:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0b993 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a98 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.006218:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ba00, rc 0) 00000100:00100000:3.0:1762166772.006256:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:41228:x1847765440056320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 405us (522us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166772.006264:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2655 00000100:00100000:0.0:1762166772.007111:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.007137:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440056448 00000100:00100000:3.0:1762166772.007141:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440056448 00000100:00100000:3.0:1762166772.007171:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2656 00000100:00100000:3.0:1762166772.007178:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:41228:x1847765440056448:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166772.007211:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007221:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007228:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007236:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007242:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007248:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007279:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007287:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007293:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166772.007326:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2:0x0]: returning size 0 00000004:00200000:3.0:1762166772.007330:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166772.007340:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007357:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007363:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007367:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007372:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007376:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.007379:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007383:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007391:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694100) 00010000:00010000:3.0:1762166772.007393:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.007396:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007401:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007413:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007418:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007422:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007434:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.007436:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007442:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007449:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166772.007451:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.007453:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007458:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a000/0x2f180c4effb0b9af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007467:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007472:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007501:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007505:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.007508:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007513:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007519:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2:0x0].0x0 (ffff945bc4694e00) 00010000:00010000:3.0:1762166772.007522:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.007531:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.007536:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0b9b6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166772.007581:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:41228:x1847765440056448:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 403us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166772.007588:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2656 00000100:00100000:0.0:1762166772.008742:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166772.008786:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440056576 00000100:00100000:2.0:1762166772.008792:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440056576 00000100:00100000:2.0:1762166772.008821:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 762 00000100:00100000:2.0:1762166772.008826:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:41228:x1847765440056576:12345-192.168.204.38@tcp:37:lfs.0 00000100:00100000:2.0:1762166772.010360:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:41228:x1847765440056576:12345-192.168.204.38@tcp:37:lfs.0 Request processed in 1530us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166772.010369:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 762 00000100:00100000:1.0:1762166772.011634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.011676:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440056704 00000100:00100000:3.0:1762166772.011682:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440056704 00000100:00100000:3.0:1762166772.011732:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2657 00000100:00100000:3.0:1762166772.011742:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:41228:x1847765440056704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166772.011756:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166772.011774:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b9bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7a9f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.011799:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a9f expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.011811:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a9f expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.011819:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694700) 00010000:00010000:3.0:1762166772.011822:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.011824:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:3.0:1762166772.011857:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:41228:x1847765440056704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 118us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166772.011863:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2657 00000100:00100000:0.0:1762166772.013090:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166772.013155:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440056832 00000100:00100000:2.0:1762166772.013160:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440056832 00000100:00100000:2.0:1762166772.013192:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 763 00000100:00100000:2.0:1762166772.013201:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:41228:x1847765440056832:12345-192.168.204.38@tcp:37:lfs.0 00000100:00100000:2.0:1762166772.014864:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:41228:x1847765440056832:12345-192.168.204.38@tcp:37:lfs.0 Request processed in 1662us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166772.014873:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 763 00000100:00100000:1.0:1762166772.016467:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166772.016618:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.016677:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440056960 00000100:00100000:3.0:1762166772.016705:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440056960 00000100:00100000:2.0:1762166772.016717:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440057088 00000100:00100000:2.0:1762166772.016724:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440057088 00000100:00100000:2.0:1762166772.016774:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 607 00000100:00100000:2.0:1762166772.016785:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440057088:12345-192.168.204.38@tcp:63:ll_sa.0 00000100:00100000:3.0:1762166772.016793:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2658 00000100:00100000:3.0:1762166772.016809:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:41228:x1847765440056960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166772.016815:0:6500:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166772.016825:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166772.016830:0:6500:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0b9c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7aad expref: -99 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.016842:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0b9cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7aa6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166772.016881:0:6500:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.016897:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.016908:0:6500:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.016918:0:6500:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.016925:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.016931:0:6500:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 00010000:00010000:3.0:1762166772.016944:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0b9e0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.016959:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0b9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.016970:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0b9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166772.017003:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x2:0x0]: returning size 0 00000004:00200000:3.0:1762166772.017008:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1762166772.017025:0:6500:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b9e7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 00000004:00010000:3.0:1762166772.017030:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0b9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166772.017040:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017050:0:6500:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 00010000:00010000:3.0:1762166772.017068:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0b9cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7aa6 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.017088:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0b9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7aa6 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.017095:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00000004:00200000:2.0:1762166772.017095:0:6500:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2:0x0]: returning size 0 00010000:00010000:3.0:1762166772.017106:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000004:00200000:2.0:1762166772.017108:0:6500:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1762166772.017110:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a000, rc 0) 00000004:00010000:2.0:1762166772.017138:0:6500:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017152:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017161:0:6500:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017168:0:6500:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 00000100:00100000:3.0:1762166772.017175:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:41228:x1847765440056960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 368us (706us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166772.017187:0:6500:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 00000100:00100000:3.0:1762166772.017197:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2658 00010000:00010000:2.0:1762166772.017205:0:6500:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166772.017213:0:6500:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017222:0:6500:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017236:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694700) 00010000:00010000:2.0:1762166772.017239:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166772.017245:0:6500:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017252:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0b9d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017264:0:6500:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017277:0:6500:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017283:0:6500:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017288:0:6500:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166772.017291:0:6500:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017297:0:6500:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017304:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:2.0:1762166772.017307:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166772.017310:0:6500:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017316:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0b9d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 00010000:00010000:2.0:1762166772.017345:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0b9c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7aad expref: 23 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166772.017357:0:6500:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7aad expref: 22 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166772.017364:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2:0x0].0x0 (ffff945bc477f600) 00010000:00010000:2.0:1762166772.017366:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166772.017368:0:6500:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cace00, rc 0) 00000100:00100000:2.0:1762166772.017423:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440057088:12345-192.168.204.38@tcp:63:ll_sa.0 Request processed in 642us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166772.017437:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 607 00000100:00100000:1.0:1762166772.018611:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166772.018660:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.018687:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440057216 00000100:00100000:3.0:1762166772.018694:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440057216 00000100:00100000:0.0:1762166772.018717:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440057344 00000100:00100000:0.0:1762166772.018724:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440057344 00000100:00100000:3.0:1762166772.018747:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 958 00000100:00100000:3.0:1762166772.018756:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440057216:12345-192.168.204.38@tcp:101:ll_agl.0 00010000:00010000:3.0:1762166772.018769:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166772.018782:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 959 00010000:00010000:3.0:1762166772.018785:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ab4 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1762166772.018790:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166772.018794:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+5:2417:x1847765440057344:12345-192.168.204.38@tcp:101:ll_agl.0 00010000:00010000:0.0:1762166772.018803:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1762166772.018813:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166772.018816:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b9f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7abb expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.018828:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166772.018832:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1762166772.018833:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166772.018841:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ab4 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166772.018843:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166772.018846:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166772.018853:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b9f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7abb expref: 6 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166772.018858:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ab4 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166772.018867:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b9f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7abb expref: 6 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166772.018868:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b600, rc 0) 00010000:00010000:0.0:1762166772.018878:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4a00, rc 0) 00000100:00100000:3.0:1762166772.018906:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440057216:12345-192.168.204.38@tcp:101:ll_agl.0 Request processed in 151us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166772.018909:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+6:2417:x1847765440057344:12345-192.168.204.38@tcp:101:ll_agl.0 Request processed in 118us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166772.018915:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 958 00000100:00100000:0.0:1762166772.018924:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 959 00000100:00100000:1.0:1762166772.020893:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166772.020943:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440057600 00000100:00100000:2.0:1762166772.020949:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440057600 00000100:00100000:2.0:1762166772.020981:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 764 00000100:00100000:2.0:1762166772.020987:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:41228:x1847765440057600:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166772.021288:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:41228:x1847765440057600:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 300us (399us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1762166772.021297:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 764 00000100:00100000:1.0:1762166772.026873:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.026932:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440057856 00000100:00100000:3.0:1762166772.026943:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440057856 00000100:00100000:3.0:1762166772.027013:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2659 00000100:00100000:3.0:1762166772.027027:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:41231:x1847765440057856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166772.027074:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166772.027095:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0b9fc lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ac2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.027188:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.027204:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027216:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027233:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.027241:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027248:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027369:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0ba11 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.027378:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0ba11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027386:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0ba11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166772.027396:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x2:0x0]: returning size 21 00010000:00010000:3.0:1762166772.027474:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027515:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027521:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027527:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027533:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.027538:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027546:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027559:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694800) 00010000:00010000:3.0:1762166772.027563:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.027568:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027574:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0ba03 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027588:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027594:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027600:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027605:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.027615:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027621:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027630:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xe0d9f819 (ffff945bc4694a00) 00010000:00010000:3.0:1762166772.027632:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.027635:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027641:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0ba0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xe0d9f819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.027675:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b200/0x2f180c4effb0b9fc lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ac2 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.027688:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0ba11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ac2 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.027696:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:3.0:1762166772.027698:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166772.027701:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a200, rc 0) 00000100:00100000:3.0:1762166772.027788:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:41231:x1847765440057856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 764us (925us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1762166772.027797:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2659 00000100:00100000:1.0:1762166772.028807:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166772.028859:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166772.028872:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440058112 00000100:00100000:2.0:1762166772.028879:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440058112 00000100:00100000:0.0:1762166772.028910:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440058240 00000100:00100000:0.0:1762166772.028917:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440058240 00000100:00100000:2.0:1762166772.028922:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 765 00000100:00100000:2.0:1762166772.028934:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:41231:x1847765440058112:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166772.028965:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 281 00000100:00100000:0.0:1762166772.028977:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440058240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166772.028990:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166772.029008:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0ba11 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ac2 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166772.029030:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:0.0:1762166772.029034:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166772.029073:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440058240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166772.029082:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:41231:x1847765440058112:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 148us (274us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1762166772.029085:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 281 00000100:00100000:2.0:1762166772.029097:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 765 00000100:00100000:1.0:1762166772.031256:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.031289:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440058368 00000100:00100000:3.0:1762166772.031295:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440058368 00000100:00100000:3.0:1762166772.031327:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2660 00000100:00100000:3.0:1762166772.031334:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:41231:x1847765440058368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166772.031369:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166772.031386:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0ba1f lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ac9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.031436:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.031445:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031452:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031458:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.031463:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031467:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031508:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031513:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031517:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031520:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031525:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.031534:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031541:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031552:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694800) 00010000:00010000:3.0:1762166772.031555:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.031559:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031565:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0ba26 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031577:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031583:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031589:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031594:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.031597:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031603:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031609:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:3.0:1762166772.031611:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.031613:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031625:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0ba2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.031644:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0ba1f lrc: 1/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ac9 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.031650:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694800) 00010000:00010000:3.0:1762166772.031652:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.031655:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0ba1f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ac9 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.031660:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb000, rc 0) 00000100:00100000:3.0:1762166772.031694:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:41231:x1847765440058368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 362us (442us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166772.031699:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2660 00000100:00100000:1.0:1762166772.032874:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.032906:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440058624 00000100:00100000:3.0:1762166772.032912:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440058624 00000100:00100000:3.0:1762166772.032942:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2661 00000100:00100000:3.0:1762166772.032950:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:41231:x1847765440058624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166772.032963:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166772.032966:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166772.032980:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7000/0x2f180c4effb0b907 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a67 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.032989:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694800) 00010000:00010000:3.0:1762166772.032995:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166772.033003:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba34 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ad0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.033076:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.033083:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033088:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033094:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.033099:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033102:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033464:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.033471:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033504:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166772.033512:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x4:0x0]: returning size 0 00010000:00010000:3.0:1762166772.033532:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033538:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033554:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033560:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033565:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.033569:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033575:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033583:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc4694d00) 00010000:00010000:3.0:1762166772.033586:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.033589:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033595:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba3b lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166772.033605:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002e1bc4ff reply state 00000000f5d5fa11 transno 4294967434 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033616:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.033622:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:3.0:1762166772.033624:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166772.033627:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166772.033646:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba34 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.033667:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.033672:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4:0x0].0x0 (ffff945bc4694f00) 00010000:00010000:3.0:1762166772.033674:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166772.033675:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6c00, rc 0) 00000100:00100000:3.0:1762166772.033727:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:41231:x1847765440058624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 777us (854us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1762166772.033735:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2661 00000100:00100000:1.0:1762166772.034894:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.034916:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440058880 00000100:00100000:3.0:1762166772.034921:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440058880 00000100:00100000:3.0:1762166772.034946:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2662 00000100:00100000:3.0:1762166772.034953:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:41231:x1847765440058880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166772.034965:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166772.034972:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0ba57 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ad7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.035036:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.035047:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.035055:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.035095:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.035116:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 34 pid: 6494 timeout: 491 lvb_type: 0 00000100:00100000:3.0:1762166772.035130:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446800640:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166772.035208:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166772.035921:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446800640:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166772.035943:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166772.036095:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166772.036142:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440059008 00000100:00100000:0.0:1762166772.036148:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440059008 00010000:00010000:0.0:1762166772.036175:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 35 pid: 6494 timeout: 491 lvb_type: 0 00000100:00100000:0.0:1762166772.036210:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 627 00000100:00100000:0.0:1762166772.036220:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765440059008:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166772.036232:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166772.036238:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 35 pid: 6494 timeout: 491 lvb_type: 0 00010000:00010000:0.0:1762166772.036248:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 35 pid: 6494 timeout: 491 lvb_type: 0 00010000:00010000:0.0:1762166772.036261:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6c00/0x2f180c4effb0ba49 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad0 expref: 35 pid: 6494 timeout: 491 lvb_type: 0 00010000:00010000:0.0:1762166772.036271:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4:0x0].0x0 (ffff945bc4694f00) 00010000:00010000:0.0:1762166772.036275:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166772.036280:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166772.036292:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166772.036310:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166772.036324:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.036331:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166772.036340:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765440059008:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 123us (246us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166772.036345:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x4:0x0]: returning size 0 00000100:00100000:0.0:1762166772.036346:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 627 00000004:00080000:3.0:1762166772.036594:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x19:0x0], index 0: 0 00000004:00080000:3.0:1762166772.036601:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x17:0x0], index 1: 0 00000004:00080000:3.0:1762166772.036606:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1a:0x0], index 0: 0 00000004:00080000:3.0:1762166772.036610:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1b:0x0], index 0: 0 00000004:00080000:3.0:1762166772.036614:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x18:0x0], index 1: 0 00000004:00080000:3.0:1762166772.036618:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1c:0x0], index 0: 0 00000004:00080000:3.0:1762166772.036622:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x19:0x0], index 1: 0 00010000:00010000:3.0:1762166772.036862:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.036870:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.036887:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.036893:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.036897:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.036905:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.036914:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4:0x0].0x0 (ffff945bc4694f00) 00010000:00010000:3.0:1762166772.036917:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166772.036920:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.036926:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba5e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166772.036963:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0ba57 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad7 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.036970:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4:0x0].0x0 (ffff945bc4694f00) 00010000:00010000:3.0:1762166772.036972:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166772.036975:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0ba57 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ad7 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.036985:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7600, rc 0) 00000100:00100000:3.0:1762166772.037015:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:41231:x1847765440058880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2062us (2124us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1762166772.037034:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2662 00000100:00100000:1.0:1762166772.037955:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166772.038010:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440059264 00000100:00100000:2.0:1762166772.038015:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440059264 00000100:00100000:2.0:1762166772.038049:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 766 00000100:00100000:2.0:1762166772.038055:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:41231:x1847765440059264:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166772.038230:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:41231:x1847765440059264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 175us (277us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1762166772.038236:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 766 00000100:00100000:1.0:1762166772.038854:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166772.038897:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440059520 00000100:00100000:2.0:1762166772.038901:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440059520 00000100:00100000:2.0:1762166772.038933:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 767 00000100:00100000:2.0:1762166772.038939:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:41231:x1847765440059520:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166772.039010:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:41231:x1847765440059520:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 71us (157us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1762166772.039015:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 767 00000100:00100000:1.0:1762166772.048444:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.048510:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440059776 00000100:00100000:3.0:1762166772.048523:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440059776 00000100:00100000:3.0:1762166772.048586:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2663 00000100:00100000:3.0:1762166772.048595:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:41235:x1847765440059776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166772.048620:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166772.048640:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0ba6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ade expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.048740:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048756:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048767:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048788:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048796:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048802:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048879:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048884:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048889:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048901:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048905:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.048909:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048914:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048924:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694700) 00010000:00010000:3.0:1762166772.048926:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.048930:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048934:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0ba73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048943:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048946:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048949:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048953:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.048954:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048957:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048967:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166772.048969:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.048971:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048974:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0ba7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.048995:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0ba6c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ade expref: 23 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.049002:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694700) 00010000:00010000:3.0:1762166772.049003:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166772.049005:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0ba6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ade expref: 23 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.049010:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7600, rc 0) 00000100:00100000:3.0:1762166772.049065:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:41235:x1847765440059776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 472us (637us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166772.049071:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2663 00000100:00100000:1.0:1762166772.050061:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.050095:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440059904 00000100:00100000:3.0:1762166772.050101:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440059904 00000100:00100000:3.0:1762166772.050132:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2664 00000100:00100000:3.0:1762166772.050140:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:41235:x1847765440059904:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166772.050185:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050195:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050211:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050220:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050227:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050231:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050263:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050268:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050272:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166772.050311:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2:0x0]: returning size 0 00000004:00200000:3.0:1762166772.050314:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166772.050325:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050334:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050337:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050341:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050354:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050358:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.050360:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050363:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050370:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff945bc4694700) 00010000:00010000:3.0:1762166772.050371:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.050374:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050377:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0ba81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050383:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050386:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050390:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050393:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.050395:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050398:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050409:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:3.0:1762166772.050410:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.050412:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050415:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0ba88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050420:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050423:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050426:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050428:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166772.050430:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050434:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050437:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2:0x0].0x0 (ffff945bc477f600) 00010000:00010000:3.0:1762166772.050439:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166772.050440:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166772.050443:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba8f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166772.050496:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:41235:x1847765440059904:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 358us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166772.050507:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2664 00000100:00100000:1.0:1762166772.494082:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166772.494117:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166772.494165:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440060032 00000100:00100000:0.0:1762166772.494168:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440060160 00000100:00100000:1.0:1762166772.494179:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440060032 00000100:00100000:0.0:1762166772.494179:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440060160 00002000:00100000:1.0:1762166772.494241:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x14:0x0] (0->3380) req@ffff945bc55dfb80 x1847765440060032/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:558/0 lens 3872/0 e 0 to 0 dl 1762166783 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166772.494252:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dfb80 with x1847765440060032 ext(0->3380) 00000100:00100000:0.0:1762166772.494253:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 960 00002000:00010000:1.0:1762166772.494261:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dfb80 00000100:00100000:0.0:1762166772.494272:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440060160:12345-192.168.204.38@tcp:16:kworker.0 00000100:00100000:1.0:1762166772.494293:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 464 00000100:00100000:1.0:1762166772.494301:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440060032:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:1.0:1762166772.495009:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440060032:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 705us (898us total) trans 21474836665 rc 0/0 00000100:00100000:1.0:1762166772.495017:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 464 00002000:00100000:1.0:1762166772.495025:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x14:0x0] (0->3380) req@ffff945bc55dfb80 x1847765440060032/t21474836665(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:558/0 lens 3872/448 e 0 to 0 dl 1762166783 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166772.495035:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dfb80 with x1847765440060032 ext(0->3380) 00002000:00010000:1.0:1762166772.495039:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dfb80 00000001:00080000:2.0:1762166772.495085:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836664 is committed 00000100:00100000:3.0:1762166772.495257:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440060160:12345-192.168.204.38@tcp:16:kworker.0 Request processed in 987us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166772.495266:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 960 00010000:00010000:1.0:1762166772.498609:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166772.498613:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166772.498628:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446800896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166772.498633:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446800768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166772.498698:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166772.498737:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446800896 00000100:00100000:3.0:1762166772.498746:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446800896 00000100:00100000:1.0:1762166772.498766:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1762166772.498801:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166772.498815:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446800768 00000100:00100000:1.0:1762166772.498821:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446800768 00000100:00100000:3.0:1762166772.498832:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1762166772.498846:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446800896:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1762166772.498857:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1762166772.498872:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 17125056 pending 28672 free 3922432000 avail 3690909696 00000100:00100000:1.0:1762166772.498872:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1762166772.498886:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446800768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1762166772.498901:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 17125056 pending 28672 free 3922432000 avail 3690909696 00000100:00100000:3.0:1762166772.498932:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446800896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166772.498940:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1762166772.498950:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836663 gen 2 00000100:00100000:1.0:1762166772.498957:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446800768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000004:00080000:0.0:1762166772.498957:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28000, transno 21474836662 00000004:00080000:0.0:1762166772.498970:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc95b1880, transno 21474836663 00000100:00100000:0.0:1762166772.498986:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446800896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166772.498987:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1762166772.498994:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446800768:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1762166772.500060:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968888 is committed 00000004:00080000:0.0:1762166772.500075:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00000004:00080000:0.0:1762166772.500085:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00010000:00010000:2.0:1762166772.500110:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166772.500123:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166772.500132:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166772.500138:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166772.500144:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166772.500154:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166772.500173:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:2.0:1762166772.500178:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166772.500179:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446801024:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166772.500185:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166772.500194:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0b6c9 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166772.500200:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446801152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166772.500216:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166772.500225:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166772.500231:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166772.500237:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166772.500242:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166772.500245:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166772.500254:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166772.500257:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166772.500269:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:2.0:1762166772.500273:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166772.500277:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446801024 00010000:00010000:2.0:1762166772.500277:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166772.500284:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446801024 00010000:00010000:2.0:1762166772.500286:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0b882 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166772.500302:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446801152 00010000:00010000:2.0:1762166772.500305:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166772.500307:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446801152 00010000:00010000:2.0:1762166772.500316:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166772.500323:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166772.500339:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00000100:00080000:0.0:1762166772.500339:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1762166772.500346:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166772.500354:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166772.500355:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:3.0:1762166772.500368:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446801152:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762166772.500370:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0xcaa2b802 (ffff945cd0738f00) 00010000:00010000:2.0:1762166772.500377:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166772.500380:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166772.500387:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0b93f lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x5:0x0].0xcaa2b802 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00002000:00080000:3.0:1762166772.500395:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:61 count 1 00000100:00100000:2.0:1762166772.500445:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1762166772.500451:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446801024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762166772.500463:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:64 count 1 00010000:00010000:2.0:1762166772.500504:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166772.500520:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 10 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166772.500526:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166772.500528:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166772.500532:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166772.500538:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166772.500546:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.500555:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166772.500565:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166772.500565:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 10 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166772.500571:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.500599:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166772.500601:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 10 pid: 9168 timeout: 491 lvb_type: 1 00010000:00010000:3.0:1762166772.500623:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166772.500626:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446801280:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166772.500637:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166772.500655:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166772.500681:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166772.500690:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166772.500698:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccafbdd80 going to sleep for 11 seconds 00010000:00010000:1.0:1762166772.500715:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166772.500722:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.500732:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.500748:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.500756:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6400/0x2f180c4effb0ba9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.500775:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166772.500777:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166772.500780:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166772.500931:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446801152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 565us (680us total) trans 17179869352 rc 0/0 00000100:00100000:3.0:1762166772.500939:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000004:00080000:1.0:1762166772.500959:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4531180/2, rc 0, transno 17179869352 00000100:00100000:1.0:1762166772.500971:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446801152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166772.502060:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446801280:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166772.502080:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166772.502128:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166772.502176:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440060288 00000100:00100000:0.0:1762166772.502182:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440060288 00010000:00010000:0.0:1762166772.502209:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 11 pid: 9168 timeout: 491 lvb_type: 1 00000100:00100000:0.0:1762166772.502252:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 628 00000100:00100000:0.0:1762166772.502262:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440060288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166772.502277:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166772.502282:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 11 pid: 9168 timeout: 491 lvb_type: 1 00010000:00010000:0.0:1762166772.502296:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 11 pid: 9168 timeout: 491 lvb_type: 1 00010000:00010000:0.0:1762166772.502315:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0b78d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a0c expref: 11 pid: 9168 timeout: 491 lvb_type: 1 00010000:00010000:0.0:1762166772.502328:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166772.502330:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166772.502334:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166772.502342:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166772.502378:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166772.502411:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166772.502418:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440060288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 156us (297us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166772.502421:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166772.502434:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166772.502434:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 628 00010000:00010000:2.0:1762166772.502443:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166772.502463:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166772.502503:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166772.502513:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.502520:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cade00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166772.502524:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.502530:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.502541:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.502549:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0ba96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166772.502567:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166772.502570:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166772.502572:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166772.502692:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446801024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2239us (2475us total) trans 21474836666 rc 0/0 00000100:00100000:2.0:1762166772.502713:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000004:00080000:0.0:1762166772.502730:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406e300/2, rc 0, transno 21474836666 00000100:00100000:0.0:1762166772.502744:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446801024:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1762166773.011718:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967437 is committed 00000004:00080000:3.0:1762166773.011743:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 9 committed 00000004:00080000:3.0:1762166773.011757:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 12 committed 00010000:00010000:0.0:1762166773.011762:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166773.011775:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166773.011784:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166773.011792:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166773.011798:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166773.011799:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 9 batchid updated 00010000:00010000:0.0:1762166773.011810:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166773.011828:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00010000:00010000:0.0:1762166773.011831:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:0.0:1762166773.011836:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166773.011841:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166773.011847:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0b7cc lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166773.011869:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.011878:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166773.011883:0:7435:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945cf1fbe300 with version 17 00010000:00010000:0.0:1762166773.011885:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.011895:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166773.011907:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166773.011910:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 9 cancel update log [0x200000401:0x2:0x0].7: rc = 0 00010000:00010000:0.0:1762166773.011916:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.011928:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:0.0:1762166773.011931:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166773.011936:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166773.011937:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446801408:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1762166773.011948:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0b8c1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166773.011966:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 17 rpc_version 17 00010000:00010000:0.0:1762166773.011970:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166773.011972:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 9 cancel update log [0x240000400:0x2:0x0].8: rc = 0 00000020:00080000:3.0:1762166773.011981:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00010000:00010000:0.0:1762166773.011983:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.011989:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.011995:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a800 already unused, calling callback (ffffffffc18e2310) 00000020:00100000:1.0:1762166773.011998:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1762166773.011999:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1762166773.011999:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166773.012015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166773.012017:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166773.012023:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc2d5c380 x1847765446801792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166773.012024:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446801536:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1762166773.012030:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:0.0:1762166773.012040:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166773.012047:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.012069:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a800/0x2f180c4effb0b98c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166773.012072:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446801792:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166773.012085:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446801408 00000100:00100000:3.0:1762166773.012088:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166773.012093:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446801408 00010000:00010000:0.0:1762166773.012098:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.012106:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.012112:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.012118:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166773.012122:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.012129:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166773.012136:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446801536 00000100:00100000:2.0:1762166773.012140:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446801536 00010000:00010000:0.0:1762166773.012140:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc4180900) 00010000:00010000:0.0:1762166773.012146:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166773.012150:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166773.012156:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6200/0x2f180c4effb0ba42 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166773.012166:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166773.012173:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1762166773.012187:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00080000:0.0:1762166773.012189:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166773.012192:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446801408:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166773.012199:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446801536:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1762166773.012212:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6e40 going to sleep for 11 seconds 00002000:00080000:2.0:1762166773.012218:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:20 count 1 00002000:00080000:3.0:1762166773.012220:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:21 count 1 00010000:00010000:3.0:1762166773.012242:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166773.012245:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446801792 00000100:00100000:1.0:1762166773.012253:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446801792 00010000:00010000:3.0:1762166773.012266:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 9 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166773.012276:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166773.012279:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166773.012282:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166773.012303:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166773.012309:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.012316:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 9 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166773.012318:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166773.012328:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00010000:00010000:2.0:1762166773.012329:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166773.012337:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 9 pid: 8383 timeout: 492 lvb_type: 1 00010000:00010000:2.0:1762166773.012340:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166773.012351:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7425:x1847765446801792:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1762166773.012370:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166773.012376:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166773.012378:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446801920:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166773.012386:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166773.012404:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166773.012421:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166773.012429:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166773.012450:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe600 going to sleep for 11 seconds 00010000:00010000:0.0:1762166773.012450:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166773.012457:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166773.012466:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166773.012520:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166773.012530:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0baab lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166773.012562:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166773.012565:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166773.012568:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166773.012609:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446801536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 414us (531us total) trans 17179869353 rc 0/0 00000100:00100000:2.0:1762166773.012623:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000004:00080000:3.0:1762166773.012631:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc2d5e300/2, rc 0, transno 17179869353 00000100:00100000:1.0:1762166773.012643:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7425:x1847765446801792:12345-0@lo:1000:osp_up0-1.0 Request processed in 298us (479us total) trans 4294968889 rc 0/0 00000100:00100000:3.0:1762166773.012645:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446801536:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1762166773.012662:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1762166773.012670:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446801792:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1762166773.013642:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446801920:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166773.013782:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166773.013836:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166773.013871:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440060416 00000100:00100000:2.0:1762166773.013876:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440060416 00010000:00010000:2.0:1762166773.013901:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 10 pid: 8383 timeout: 492 lvb_type: 1 00000100:00080000:0.0:1762166773.013909:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166773.013923:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 629 00000100:00100000:2.0:1762166773.013931:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440060416:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166773.013938:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166773.013942:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 10 pid: 8383 timeout: 492 lvb_type: 1 00010000:00010000:2.0:1762166773.013950:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 10 pid: 8383 timeout: 492 lvb_type: 1 00010000:00010000:2.0:1762166773.013962:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0b8b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a52 expref: 10 pid: 8383 timeout: 492 lvb_type: 1 00010000:00010000:2.0:1762166773.013970:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166773.013980:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166773.013984:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166773.013994:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166773.014021:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166773.014056:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166773.014065:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440060416:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (229us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166773.014071:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166773.014081:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 629 00010000:00010000:3.0:1762166773.014093:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.014099:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166773.014119:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166773.014153:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166773.014165:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.014175:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166773.014179:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.014188:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.014206:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.014215:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0baa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166773.014239:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166773.014242:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166773.014244:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166773.014322:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446801408:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2140us (2318us total) trans 21474836667 rc 0/0 00000100:00100000:3.0:1762166773.014329:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000004:00080000:2.0:1762166773.014355:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3cc9500/2, rc 0, transno 21474836667 00000100:00100000:2.0:1762166773.014367:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446801408:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1762166773.522723:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3634:1847765446802048:0@lo:400:kworker.0 00010000:00010000:1.0:1762166773.522725:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166773.522749:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1847765446802176:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.522756:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765446802304:0@lo:400:kworker.0 00000100:00100000:0.0:1762166773.522827:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166773.522830:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166773.522851:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446802432:0@lo:400:kworker.0 00000100:00100000:3.0:1762166773.522891:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446802304 00000100:00100000:3.0:1762166773.522901:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446802304 00000100:00100000:1.0:1762166773.522914:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446802816:0@lo:400:kworker.0 00000100:00100000:0.0:1762166773.522915:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446802560:0@lo:400:kworker.0 00000100:00100000:2.0:1762166773.522918:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166773.522960:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446802944:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.522970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166773.522974:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166773.522995:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446802816 00000100:00100000:3.0:1762166773.523001:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446802816 00000100:00100000:1.0:1762166773.523005:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1762166773.523012:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166773.523013:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446803072:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523017:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446802688:0@lo:400:kworker.0 00000100:00100000:0.0:1762166773.523059:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166773.523063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166773.523065:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446802944 00000100:00100000:3.0:1762166773.523073:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446802944 00000100:00100000:2.0:1762166773.523076:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446803072 00000100:00100000:2.0:1762166773.523085:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446803072 00000100:00100000:1.0:1762166773.523090:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446803200:0@lo:400:kworker.0 00000100:00080000:0.0:1762166773.523111:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1762166773.523118:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166773.523126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166773.523136:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1762166773.523137:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446803200 00000100:00100000:0.0:1762166773.523147:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446803200 00000100:00100000:2.0:1762166773.523156:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1762166773.523164:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765446802304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523171:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1762166773.523177:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446802816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523183:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446802944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166773.523194:0:12357:0:(service.c:3434:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1762166773.523204:0:12357:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1762166773.523256:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446802944:12345-0@lo:400:kworker.0 Request processed in 73us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166773.523262:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446802816:12345-0@lo:400:kworker.0 Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166773.523263:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765446802304:12345-0@lo:400:kworker.0 Request processed in 103us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166773.523268:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1762166773.523276:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1762166773.523294:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1762166773.523302:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1762166773.523310:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00080000:0.0:1762166773.523314:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166773.523315:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446803072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166773.523329:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446803200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166773.523334:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446802048 00000100:00100000:0.0:1762166773.523339:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446802048 00000100:00100000:3.0:1762166773.523357:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446802560 00000100:00100000:3.0:1762166773.523365:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446802560 00000100:00100000:1.0:1762166773.523368:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446803072:12345-0@lo:400:kworker.0 Request processed in 57us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166773.523380:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1762166773.523392:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1762166773.523393:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446803200:12345-0@lo:400:kworker.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166773.523405:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1762166773.523408:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3634:x1847765446802048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166773.523441:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446802688 00000100:00100000:1.0:1762166773.523445:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446803200:0@lo:400:kworker.0 00000100:00100000:3.0:1762166773.523449:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446802688 00000100:00100000:0.0:1762166773.523461:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3634:x1847765446802048:12345-0@lo:400:kworker.0 Request processed in 56us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166773.523463:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446802944:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523465:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446802816:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523512:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765446802304:0@lo:400:kworker.0 00000100:00100000:0.0:1762166773.523528:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1762166773.523535:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1762166773.523547:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446802560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523560:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446802432 00000100:00100000:1.0:1762166773.523564:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446802432 00000100:00100000:2.0:1762166773.523570:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1762166773.523590:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446802688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166773.523606:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446802560:12345-0@lo:400:kworker.0 Request processed in 63us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166773.523617:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1762166773.523624:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1762166773.523640:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446802432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166773.523663:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446802688:12345-0@lo:400:kworker.0 Request processed in 77us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166773.523693:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1762166773.523716:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446802688:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523743:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446802432:12345-0@lo:400:kworker.0 Request processed in 106us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166773.523750:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446802432:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523754:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1762166773.523772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166773.523799:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446802560:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523816:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446802176 00000100:00100000:2.0:1762166773.523820:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446803072:0@lo:400:kworker.0 00000100:00100000:1.0:1762166773.523823:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446802176 00000100:00100000:2.0:1762166773.523842:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3634:1847765446802048:0@lo:400:kworker.0 00000100:00100000:0.0:1762166773.523869:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1762166773.523881:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1847765446802176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166773.523935:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1847765446802176:12345-0@lo:400:kworker.0 Request processed in 57us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166773.523944:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1762166773.523967:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1847765446802176:0@lo:400:kworker.0 00000100:00100000:1.0:1762166774.028974:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166774.029007:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166774.029042:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166774.029070:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440060544 00000100:00100000:1.0:1762166774.029080:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166774.029086:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440060544 00000100:00100000:2.0:1762166774.029090:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440060672 00000100:00100000:3.0:1762166774.029099:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440060800 00000100:00100000:2.0:1762166774.029102:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440060672 00000100:00100000:3.0:1762166774.029106:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440060800 00000100:00100000:1.0:1762166774.029139:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166774.029175:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440060928 00000100:00100000:0.0:1762166774.029179:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 598 00000100:00100000:1.0:1762166774.029183:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440060928 00000100:00100000:3.0:1762166774.029191:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 392 00000100:00100000:0.0:1762166774.029193:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2418:x1847765440060544:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166774.029207:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 393 00000100:00100000:3.0:1762166774.029214:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440060800:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166774.029217:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440061056 00000100:00100000:2.0:1762166774.029222:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440060672:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166774.029223:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440061056 00000100:00100000:1.0:1762166774.029250:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 236 00000100:00100000:1.0:1762166774.029259:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440060928:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166774.029281:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2418:x1847765440060544:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 91us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166774.029293:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440060672:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166774.029294:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440060800:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166774.029300:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 598 00000100:00100000:1.0:1762166774.029303:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440060928:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166774.029319:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 393 00000100:00100000:1.0:1762166774.029321:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 236 00000100:00100000:3.0:1762166774.029330:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 392 00000100:00100000:1.0:1762166774.029345:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 237 00000100:00100000:1.0:1762166774.029358:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+6:2418:x1847765440061056:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:0.0:1762166774.029368:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166774.029376:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166774.029390:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+6:2418:x1847765440061056:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 35us (250us total) trans 0 rc 0/0 00000100:00080000:0.0:1762166774.029396:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166774.029409:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 237 00000100:00100000:0.0:1762166774.364088:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166774.364140:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440061312 00000100:00100000:3.0:1762166774.364150:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440061312 00000100:00100000:3.0:1762166774.364207:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2665 00000100:00100000:3.0:1762166774.364219:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:41938:x1847765440061312:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166774.364240:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166774.364276:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bab2 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ae5 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166774.364335:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166774.364345:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364354:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364361:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166774.364365:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364369:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364437:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364442:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364445:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364449:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166774.364452:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364456:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364470:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc580a800) 00010000:00010000:3.0:1762166774.364472:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166774.364475:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364500:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bab9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364509:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364512:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364515:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364518:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166774.364520:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364523:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364527:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc580a300) 00010000:00010000:3.0:1762166774.364528:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166774.364530:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364532:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bac0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.364553:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bab2 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ae5 expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166774.364565:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc580a800) 00010000:00010000:3.0:1762166774.364566:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166774.364569:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bab2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ae5 expref: 13 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166774.364576:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6e00, rc 0) 00000100:00100000:3.0:1762166774.364618:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:41938:x1847765440061312:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 404us (541us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166774.364623:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2665 00000100:00100000:2.0:1762166774.365772:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166774.365801:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440061440 00000100:00100000:3.0:1762166774.365806:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440061440 00000100:00100000:3.0:1762166774.365832:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2666 00000100:00100000:3.0:1762166774.365838:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:41938:x1847765440061440:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166774.365876:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166774.365886:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.365894:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.365905:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166774.365911:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.365915:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.365957:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166774.365965:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.365972:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:3.0:1762166774.366013:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x4:0x0]: returning size 0 00000004:00200000:3.0:1762166774.366017:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166774.366027:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366036:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366040:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366044:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366047:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166774.366049:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366052:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366058:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff945bc580a900) 00010000:00010000:3.0:1762166774.366059:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166774.366061:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366069:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bac7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366079:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366082:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366085:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366088:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166774.366090:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366093:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366096:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xd6c8d217 (ffff945bc580a700) 00010000:00010000:3.0:1762166774.366098:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166774.366099:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366102:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bace lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0xd6c8d217 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366107:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366110:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366119:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366122:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166774.366123:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366126:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366130:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x4:0x0].0x0 (ffff945bc580ab00) 00010000:00010000:3.0:1762166774.366131:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166774.366133:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:3.0:1762166774.366135:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bad5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166774.366173:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:41938:x1847765440061440:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 335us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166774.366179:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2666 00010000:00010000:1.0:1762166774.546703:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166775.058713:0:10005:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394207232705ns, next at 395207227954ns, rc = 0 00000004:00080000:0.0:1762166775.058713:0:9996:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 394207232640ns, next at 395207228153ns, rc = 0 00000100:00100000:1.0:1762166775.058725:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762166775.058740:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446803456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166775.058772:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446803328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1762166775.058827:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166775.058870:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446803456 00000100:00100000:1.0:1762166775.058881:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446803456 00000100:00100000:2.0:1762166775.058894:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166775.058938:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446803328 00000100:00100000:0.0:1762166775.058945:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446803328 00000100:00080000:2.0:1762166775.058978:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166775.058979:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1762166775.059000:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446803456:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166775.059013:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1762166775.059023:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446803328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1762166775.059039:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00002000:00000024:0.0:1762166775.059045:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1762166775.059142:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446803456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166775.059152:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446803328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166775.059162:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1762166775.059174:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1762166775.059179:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446803328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1762166775.059213:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446803456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1762166775.570638:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166775.570716:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446803584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166775.570773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166775.570818:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446803584 00000100:00100000:1.0:1762166775.570828:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446803584 00000100:00100000:1.0:1762166775.570876:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1762166775.570885:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446803584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1762166775.570918:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445986304 avail 1299746816 00000100:00100000:1.0:1762166775.570969:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446803584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166775.570976:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1762166775.571014:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446803584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166776.082893:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166776.082931:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446803712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166776.082997:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166776.083179:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446803712 00000100:00100000:1.0:1762166776.083194:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446803712 00000100:00100000:1.0:1762166776.083266:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1762166776.083278:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446803712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1762166776.083323:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446236160 avail 1299996672 00000100:00100000:1.0:1762166776.083410:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446803712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166776.083418:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1762166776.083507:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446803712:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1762166776.594683:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166777.618616:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166777.618622:0:9159:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 396767142792ns, next at 397767139997ns, rc = 0 00000100:00100000:0.0:1762166777.618662:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446803840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166777.618729:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166777.618853:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446803840 00000100:00100000:1.0:1762166777.618861:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446803840 00000100:00080000:2.0:1762166777.618905:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166777.618924:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1762166777.618935:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446803840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1762166777.618961:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 17125056 pending 28672 free 3922427904 avail 3690905600 00000100:00100000:1.0:1762166777.619011:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446803840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166777.619019:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1762166777.619056:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446803840:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1762166777.619748:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836667 is committed 00000001:00080000:2.0:1762166777.619765:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836666 is committed 00000001:00080000:2.0:1762166777.619772:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836665 is committed 00000004:00080000:1.0:1762166777.619775:0:9164:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396768295725ns, next at 397768293810ns, rc = 0 00000100:00100000:1.0:1762166777.619795:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166777.619805:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446803968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166777.619839:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166777.619877:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446803968 00000100:00100000:1.0:1762166777.619881:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446803968 00000100:00100000:1.0:1762166777.619934:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1762166777.619941:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446803968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166777.619954:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 17096384 pending 0 free 3922427904 avail 3690876928 00000100:00100000:1.0:1762166777.619984:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446803968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166777.619991:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1762166777.620021:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836666 gen 2 00000004:00080000:1.0:1762166777.620027:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406e300, transno 21474836666 00000100:00080000:3.0:1762166777.620059:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166777.620091:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446803968:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1762166777.620765:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00000004:00080000:0.0:1762166777.620782:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000001:00080000:0.0:1762166777.620795:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968889 is committed 00000001:00080000:3.0:1762166777.620845:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869353 is committed 00000001:00080000:3.0:1762166777.620854:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869352 is committed 00000100:00100000:3.0:1762166777.620873:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446804480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166777.620877:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446804096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166777.620897:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446804224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166777.620920:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166777.620947:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166777.620961:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166777.620963:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446804480 00000100:00100000:1.0:1762166777.620969:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446804480 00000100:00100000:3.0:1762166777.620970:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446804608:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166777.620982:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166777.620993:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446804352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166777.621001:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166777.621015:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446804224 00000100:00100000:1.0:1762166777.621019:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446804224 00000100:00100000:0.0:1762166777.621033:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166777.621048:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446804608 00000100:00100000:1.0:1762166777.621052:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446804608 00000100:00100000:3.0:1762166777.621059:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446804352 00000100:00100000:3.0:1762166777.621066:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446804352 00000100:00100000:1.0:1762166777.621081:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1762166777.621091:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446804480:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166777.621094:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:0.0:1762166777.621109:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446804224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166777.621114:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:66 count 1 00000100:00100000:3.0:1762166777.621115:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:3.0:1762166777.621131:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446804608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1762166777.621138:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:65 count 1 00002000:00010000:1.0:1762166777.621146:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:3.0:1762166777.621150:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:67 count 1 00010000:00010000:1.0:1762166777.621157:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166777.621171:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166777.621172:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166777.621175:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.621181:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.621183:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621203:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.621207:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166777.621209:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621212:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.621220:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166777.621229:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166777.621231:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621243:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621247:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.621254:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166777.621262:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166777.621266:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166777.621270:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621294:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621294:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621318:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621319:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621340:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621346:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1762166777.621360:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1762166777.621451:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3633:x1847765446804480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 361us (530us total) trans 21474836668 rc 0/0 00000100:00100000:1.0:1762166777.621460:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1762166777.621514:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765446804608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 386us (513us total) trans 21474836669 rc 0/0 00000100:00100000:1.0:1762166777.621515:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1762166777.621525:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1762166777.621529:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446804352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762166777.621544:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:63 count 1 00010000:00010000:3.0:1762166777.621556:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1762166777.621562:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621567:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166777.621571:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621577:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621589:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621594:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0badc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166777.621600:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166777.621622:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.621631:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166777.621633:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166777.621637:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621639:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166777.621646:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.621651:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621657:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166777.621665:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621666:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.621685:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621688:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166777.621703:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446804224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 596us (756us total) trans 21474836670 rc 0/0 00010000:00010000:3.0:1762166777.621710:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166777.621710:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1762166777.621715:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00010000:00010000:3.0:1762166777.621725:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bae3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621746:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166777.621753:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621754:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166777.621762:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621766:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166777.621771:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166777.621778:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621780:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621799:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621802:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.621828:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621833:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166777.621839:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446804352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 312us (806us total) trans 17179869354 rc 0/0 00010000:00010000:0.0:1762166777.621844:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0baea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.621856:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0baf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166777.621857:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00010000:00010000:0.0:1762166777.621881:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166777.621885:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166777.621886:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166777.621889:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166777.621891:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166777.621892:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166777.621899:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166777.621899:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1762166777.621912:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1762166777.621945:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc494ea00/2, rc 0, transno 21474836669 00000100:00100000:3.0:1762166777.621952:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446804608:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1762166777.621965:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc494dc00/2, rc 0, transno 21474836668 00000100:00100000:3.0:1762166777.621969:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446804480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166777.621978:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869352 gen 2 00000004:00080000:0.0:1762166777.621984:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4531180, transno 17179869352 00000100:00100000:3.0:1762166777.622007:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166777.622012:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945ceffd0a80 x1847765446804352/t17179869354(17179869354) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166793 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166777.622023:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd0a80/2, rc 0, transno 17179869354 00000100:00100000:0.0:1762166777.622029:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446804352:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1762166777.622047:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc494fb80/2, rc 0, transno 21474836670 00000100:00100000:0.0:1762166777.622053:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446804224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166777.622055:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446804096 00000100:00100000:3.0:1762166777.622061:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446804096 00000100:00100000:3.0:1762166777.622111:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1762166777.622119:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446804096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1762166777.622132:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:62 count 1 00002000:00010000:3.0:1762166777.622180:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166777.622185:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.622194:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.622196:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166777.622206:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.622215:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.622223:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.622229:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166777.622247:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166777.622256:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166777.622263:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.622285:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166777.622290:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.622298:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.622312:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.622320:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0baf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166777.622336:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166777.622339:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166777.622342:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166777.622356:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446804096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 237us (347us total) trans 17179869355 rc 0/0 00000100:00100000:3.0:1762166777.622363:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000004:00080000:3.0:1762166777.622390:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4010e00/2, rc 0, transno 17179869355 00000100:00100000:3.0:1762166777.622396:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446804096:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166778.642750:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166778.642793:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446804864:0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.642816:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446805120:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.642850:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446804736:0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.642906:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166778.642917:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.642922:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446804992:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.642997:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446805248:0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.642998:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446805376:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.643066:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446804736 00000100:00100000:1.0:1762166778.643073:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.643075:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166778.643081:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446804736 00000100:00100000:1.0:1762166778.643128:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446805888:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.643146:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1762166778.643151:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446805504:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.643163:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446804736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.643169:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.643205:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166778.643239:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446804864 00000100:00100000:1.0:1762166778.643245:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446804864 00000100:00100000:0.0:1762166778.643253:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446804736:12345-0@lo:400:kworker.0 Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166778.643255:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446806016:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.643273:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1762166778.643290:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446805888 00000100:00100000:1.0:1762166778.643295:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446805888 00000100:00100000:2.0:1762166778.643309:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166778.643345:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446804992 00000100:00100000:0.0:1762166778.643350:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446804992 00000100:00100000:1.0:1762166778.643354:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446806016 00000100:00100000:1.0:1762166778.643360:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446806016 00000100:00100000:2.0:1762166778.643375:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166778.643388:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1762166778.643393:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1847765446806144:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.643403:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446804992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.643405:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1762166778.643428:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446804864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.643511:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446804992:12345-0@lo:400:kworker.0 Request processed in 75us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.643512:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446804864:12345-0@lo:400:kworker.0 Request processed in 89us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166778.643527:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166778.643534:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1762166778.643534:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1762166778.643566:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446806144 00000100:00100000:1.0:1762166778.643571:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446806144 00000100:00100000:0.0:1762166778.643577:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446805376 00000100:00100000:2.0:1762166778.643579:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968889 gen 2 00000100:00100000:0.0:1762166778.643596:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446805376 00000004:00080000:2.0:1762166778.643601:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968889 committed transno 4294968889 00000100:00100000:1.0:1762166778.643607:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1762166778.643617:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446805888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.643642:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446804992:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.643645:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446805504 00000100:00100000:0.0:1762166778.643652:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446805504 00000100:00100000:1.0:1762166778.643664:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446805888:12345-0@lo:400:kworker.0 Request processed in 45us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.643672:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1762166778.643704:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1762166778.643704:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1762166778.643720:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446806016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.643722:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446805376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.643734:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1762166778.643753:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446805504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.643775:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446806016:12345-0@lo:400:kworker.0 Request processed in 60us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.643782:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446805376:12345-0@lo:400:kworker.0 Request processed in 68us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.643797:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1762166778.643798:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1762166778.643829:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1762166778.643848:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1847765446806144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.643849:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446805504:12345-0@lo:400:kworker.0 Request processed in 94us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.643873:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.643880:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1762166778.643905:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446805632:0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.643912:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1847765446806144:12345-0@lo:400:kworker.0 Request processed in 76us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.643920:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1762166778.643930:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446805120 00000100:00100000:2.0:1762166778.643939:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446805120 00000100:00100000:0.0:1762166778.643952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1762166778.643956:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1762166778.643962:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166778.643998:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1762166778.644007:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446805120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.644026:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446805632 00000100:00100000:2.0:1762166778.644033:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446805632 00000100:00100000:1.0:1762166778.644052:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446805120:12345-0@lo:400:kworker.0 Request processed in 46us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.644060:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1762166778.644060:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446805888:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.644090:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446804864:0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.644106:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1762166778.644109:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836667 gen 2 00000100:00080000:1.0:1762166778.644110:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1762166778.644119:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3cc9500, transno 21474836667 00000100:00100000:2.0:1762166778.644126:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446805632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.644143:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446805376:0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.644154:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446805120:0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.644202:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446805632:12345-0@lo:400:kworker.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.644205:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869353 gen 2 00000004:00080000:1.0:1762166778.644212:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2d5e300, transno 17179869353 00000100:00100000:2.0:1762166778.644213:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1762166778.644234:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446805632:0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.644423:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1847765446806144:0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.644441:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446805504:0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.644459:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166778.644465:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446806016:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.644777:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446805248 00000100:00100000:0.0:1762166778.644783:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446805248 00000100:00100000:2.0:1762166778.644803:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446805760:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.644841:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1762166778.644849:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.644887:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446806272:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.644894:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446805248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166778.644932:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166778.644960:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446805248:12345-0@lo:400:kworker.0 Request processed in 105us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.644969:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1762166778.644999:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446804736:0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.645006:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446806272 00000100:00100000:1.0:1762166778.645018:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446806272 00000100:00100000:2.0:1762166778.645024:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446805248:0@lo:400:kworker.0 00000100:00080000:0.0:1762166778.645065:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166778.645092:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446805760 00000100:00100000:2.0:1762166778.645101:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446805760 00000100:00100000:1.0:1762166778.645101:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1762166778.645122:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446806272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.645161:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1762166778.645184:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446806272:12345-0@lo:400:kworker.0 Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.645193:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1762166778.645217:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446805760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166778.645239:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446806272:0@lo:400:kworker.0 00000100:00100000:0.0:1762166778.645276:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446805760:12345-0@lo:400:kworker.0 Request processed in 91us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.645283:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1762166778.645298:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446805760:0@lo:400:kworker.0 00000004:00080000:2.0:1762166778.645302:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 13 committed 00000004:00080000:2.0:1762166778.645327:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 10 committed 00000100:00100000:2.0:1762166778.645388:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446806400:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166778.645437:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446806656:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166778.645443:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166778.645457:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446806784:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1762166778.645522:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446806912:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166778.645538:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.645583:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446806400 00000100:00100000:2.0:1762166778.645603:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446806400 00000100:00100000:1.0:1762166778.645617:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166778.645632:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446806528:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1762166778.645648:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446806656 00000100:00100000:2.0:1762166778.645653:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446806656 00000100:00100000:0.0:1762166778.645675:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.645699:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446806784 00000100:00100000:2.0:1762166778.645702:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446806784 00000100:00100000:1.0:1762166778.645721:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1762166778.645739:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1762166778.645741:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446806400:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166778.645751:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1762166778.645759:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446806656:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166778.645771:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446806784:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1762166778.645772:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:22 count 1 00000100:00100000:0.0:1762166778.645775:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1762166778.645778:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:23 count 1 00002000:00080000:2.0:1762166778.645809:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:22 count 1 00000100:00100000:0.0:1762166778.645826:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166778.645856:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446806912 00000100:00100000:0.0:1762166778.645860:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446806912 00000100:00100000:0.0:1762166778.645880:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446806528 00000100:00100000:0.0:1762166778.645882:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446806528 00000100:00100000:0.0:1762166778.645900:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1762166778.645911:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446806912:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1762166778.645928:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:24 count 1 00002000:00010000:3.0:1762166778.645933:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1762166778.645934:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1762166778.645938:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166778.645955:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.645955:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.645956:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166778.645997:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166778.646012:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.646016:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166778.646017:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166778.646017:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166778.646024:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166778.646025:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166778.646035:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166778.646038:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646039:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646040:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166778.646045:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166778.646046:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646052:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646081:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646113:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.646114:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646115:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646123:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.646173:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646174:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646177:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646177:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.646216:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646226:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646243:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646245:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166778.646280:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1762166778.646289:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1762166778.646298:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1762166778.646568:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765446806400:12345-0@lo:6:osp-syn-0-1.0 Request processed in 837us (1133us total) trans 21474836671 rc 0/0 00000100:00100000:1.0:1762166778.646577:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:0.0:1762166778.646599:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765446806912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 678us (816us total) trans 21474836673 rc 0/0 00000100:00100000:0.0:1762166778.646612:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1762166778.646627:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1762166778.646629:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446806656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 875us (1093us total) trans 21474836672 rc 0/0 00000100:00100000:3.0:1762166778.646640:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1762166778.646644:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446806528:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1762166778.646649:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1762166778.646651:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446806784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 881us (976us total) trans 17179869356 rc 0/0 00010000:00010000:0.0:1762166778.646661:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1762166778.646664:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:21 count 1 00000100:00100000:2.0:1762166778.646671:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00010000:00010000:3.0:1762166778.646674:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1762166778.646687:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646689:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166778.646698:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646702:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cade00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166778.646710:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646714:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646721:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166778.646726:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd2680/2, rc 0, transno 17179869356 00002000:00010000:1.0:1762166778.646737:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1762166778.646743:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446806784:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166778.646758:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646775:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166778.646777:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166778.646781:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646786:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646786:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646791:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646813:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646813:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646839:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cade00/0x2f180c4effb0bb0d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646839:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646849:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166778.646857:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.646866:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1762166778.646867:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166778.646873:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166778.646873:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646881:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646887:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646895:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166778.646902:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646906:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646915:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646919:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0baff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646936:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646942:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bb14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646945:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166778.646950:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.646959:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166778.646964:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166778.646968:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166778.646972:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166778.646978:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.646987:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166778.647001:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc58cfb80/2, rc 0, transno 21474836672 00010000:00010000:0.0:1762166778.647002:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166778.647014:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446806656:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166778.647015:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446806528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 377us (1188us total) trans 17179869357 rc 0/0 00010000:00010000:0.0:1762166778.647015:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb1b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166778.647032:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000004:00080000:3.0:1762166778.647043:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd3b80/2, rc 0, transno 17179869357 00010000:00010000:0.0:1762166778.647044:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166778.647048:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166778.647050:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166778.647056:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166778.647059:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446806528:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166778.647067:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166778.647078:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1762166778.647106:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc58cd880/2, rc 0, transno 21474836673 00000100:00100000:1.0:1762166778.647111:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446806912:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1762166778.647120:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc58ce680/2, rc 0, transno 21474836671 00000100:00100000:1.0:1762166778.647124:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446806400:0@lo:6:osp-syn-0-1.0 00000001:02000400:2.0:1762166778.670649:0:31013:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 46: Verify setstripe --copy option ==== 05:46:18 (1762166778) 00000100:00100000:2.0:1762166778.701221:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166778.701296:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440061568 00000100:00100000:1.0:1762166778.701309:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440061568 00000100:00080000:0.0:1762166778.701364:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166778.701403:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2667 00000100:00100000:1.0:1762166778.701416:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:43216:x1847765440061568:12345-192.168.204.38@tcp:41:stat.0 00000004:00000024:1.0:1762166778.701504:0:6495:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7845916672 avail 7382843392 00000100:00100000:1.0:1762166778.701603:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:43216:x1847765440061568:12345-192.168.204.38@tcp:41:stat.0 Request processed in 188us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166778.701613:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2667 00000100:00100000:3.0:1762166778.719455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166778.719512:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440061696 00000100:00100000:1.0:1762166778.719522:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440061696 00000100:00100000:1.0:1762166778.719574:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2668 00000100:00100000:1.0:1762166778.719602:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:43222:x1847765440061696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166778.719622:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166778.719642:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0bb22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7aec expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.719700:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719714:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719725:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719787:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719795:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719802:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719841:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719848:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719853:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719859:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719874:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166778.719878:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719886:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719898:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166778.719902:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166778.719906:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719912:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bb29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719923:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719929:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719934:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719939:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166778.719942:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719948:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719958:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x237edbbc (ffff945cd0738b00) 00010000:00010000:1.0:1762166778.719961:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166778.719969:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.719982:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0bb30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.720017:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0bb22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7aec expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.720027:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166778.720030:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166778.720033:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0bb22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7aec expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.720043:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:1.0:1762166778.720097:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:43222:x1847765440061696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 500us (651us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166778.720105:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2668 00000100:00100000:2.0:1762166778.722714:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166778.722787:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440061952 00000100:00100000:1.0:1762166778.722801:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440061952 00000100:00100000:1.0:1762166778.722891:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2669 00000100:00100000:1.0:1762166778.722911:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:43222:x1847765440061952:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166778.722980:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166778.723009:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0b63d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7995 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.723028:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166778.723034:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166778.723097:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.723119:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.723129:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.723146:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.723153:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166778.723161:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000040:00080000:1.0:1762166778.724841:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].20, 2152 off49528 00000040:00080000:1.0:1762166778.724963:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].8, 2352 off46688 00000004:00080000:1.0:1762166778.724974:0:6495:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945cf1eaf9c0 with version 18 00000004:00080000:1.0:1762166778.725006:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 18 rpc_version 18 00000020:00100000:1.0:1762166778.725056:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166778.725071:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945ceffd3800 x1847765446807168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166778.725108:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446807168:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166778.725206:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166778.725291:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166778.725333:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446807168 00000100:00100000:1.0:1762166778.725344:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446807168 00000100:00100000:1.0:1762166778.725409:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:1.0:1762166778.725423:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc635c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8087:x1847765446807168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166778.726220:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc635c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8087:x1847765446807168:12345-0@lo:1000:osp_up1-0.0 Request processed in 798us (1010us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1762166778.726238:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1762166778.726359:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446807168:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1762166778.726564:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.726578:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.726610:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.726636:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.726643:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.726651:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.726688:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.726692:0:6495:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.726698:0:6495:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166778.726718:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6495:1847765446807296:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1762166778.726777:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.726837:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785c000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166778.727294:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446807296 00000100:00100000:2.0:1762166778.727300:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446807296 00000100:00100000:2.0:1762166778.727355:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1762166778.727372:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6495:x1847765446807296:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1762166778.727395:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166778.727414:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0bb5a lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0bb53 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.727440:0:7427:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0bb5a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0bb53 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.727449:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0bb5a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0bb53 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.727455:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166778.727458:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166778.727461:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac000, rc 0) 00000100:00100000:2.0:1762166778.727551:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6495:x1847765446807296:12345-0@lo:101:mdt00_001.0 Request processed in 185us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166778.727558:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1762166778.727646:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6495:1847765446807296:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1762166778.727665:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.727675:0:6495:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166778.727695:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000098833d4c reply state 00000000cb5acca6 transno 4294968890 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727706:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727712:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166778.727714:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166778.727717:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166778.727731:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.727739:0:6495:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166778.727750:0:6495:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000004:00010000:2.0:1762166778.727757:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000098833d4c reply state 00000000cb5acca6 transno 4294968890 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727767:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727773:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166778.727776:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166778.727778:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1762166778.727784:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1762166778.727793:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727797:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727801:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727805:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727808:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166778.727811:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727816:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727829:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166778.727831:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166778.727834:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727839:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1400/0x2f180c4effb0bb37 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00010000:2.0:1762166778.727848:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000098833d4c reply state 00000000cb5acca6 transno 4294968890 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727852:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.727856:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x237edbbc (ffff945cd0738100) 00010000:00010000:2.0:1762166778.727858:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166778.727859:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1762166778.727925:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:43222:x1847765440061952:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 5023us (5217us total) trans 4294968890 rc 0/0 00000100:00100000:2.0:1762166778.727931:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2669 00000100:00100000:2.0:1762166778.733247:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.733319:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440062080 00000100:00100000:3.0:1762166778.733326:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440062080 00000100:00100000:3.0:1762166778.733374:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2670 00000100:00100000:3.0:1762166778.733385:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:43223:x1847765440062080:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166778.733408:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.733426:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bb61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7af3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.734080:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bb68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.734095:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.734103:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166778.734142:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1762166778.734144:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166778.734157:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.734176:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7400/0x2f180c4effb0bb61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7af3 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.734187:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bb68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7af3 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.734192:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166778.734202:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166778.734206:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6e00, rc 0) 00000100:00100000:3.0:1762166778.734255:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:43223:x1847765440062080:12345-192.168.204.38@tcp:101:rm.0 Request processed in 870us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166778.734263:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2670 00000100:00100000:3.0:1762166778.735511:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.735580:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440062208 00000100:00100000:3.0:1762166778.735596:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440062208 00000100:00100000:3.0:1762166778.735638:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2671 00000100:00100000:3.0:1762166778.735648:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:43223:x1847765440062208:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166778.735660:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.735670:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bb6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7afa expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.735712:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735724:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735733:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735746:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735753:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735759:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735844:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0bb84 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735852:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0bb84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735859:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0bb84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166778.735925:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1762166778.735930:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1762166778.735943:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0bb84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735954:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735961:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735968:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735974:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735982:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.735987:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.735997:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736010:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166778.736019:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.736025:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736031:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7600/0x2f180c4effb0bb76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736041:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736046:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736053:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736060:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.736063:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736069:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736078:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x237edbbc (ffff945cd0738100) 00010000:00010000:3.0:1762166778.736081:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.736084:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736090:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bb7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.736111:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bb6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7afa expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.736136:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0bb84 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7afa expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.736143:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:3.0:1762166778.736146:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166778.736149:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7200, rc 0) 00000100:00100000:3.0:1762166778.736197:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:43223:x1847765440062208:12345-192.168.204.38@tcp:101:rm.0 Request processed in 551us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166778.736205:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2671 00000100:00100000:0.0:1762166778.737398:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.737449:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440062336 00000100:00100000:3.0:1762166778.737456:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440062336 00000100:00100000:3.0:1762166778.737533:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2672 00000100:00100000:3.0:1762166778.737555:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:43223:x1847765440062336:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166778.737565:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.737578:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6000/0x2f180c4effb0bb8b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.737619:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bb92 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.737629:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bb92 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.737638:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bb92 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166778.737662:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1762166778.737666:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1762166778.737689:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6000/0x2f180c4effb0bb8b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b01 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.737699:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bb92 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b01 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.737704:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166778.737706:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166778.737707:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7a00, rc 0) 00000100:00100000:3.0:1762166778.737742:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:43223:x1847765440062336:12345-192.168.204.38@tcp:101:rm.0 Request processed in 200us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166778.737746:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2672 00000100:00100000:1.0:1762166778.738681:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.738710:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440062464 00000100:00100000:3.0:1762166778.738715:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440062464 00000100:00100000:3.0:1762166778.738750:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2673 00000100:00100000:3.0:1762166778.738757:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:43223:x1847765440062464:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166778.738766:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1762166778.738767:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1762166778.738776:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bb99 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b08 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.738805:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.738813:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0bb5a lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0bb53 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.738818:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.738841:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0bb5a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0bb53 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166778.738857:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446807424:0@lo:104: 00000100:00100000:3.0:1762166778.738889:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166778.738935:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446807424 00000100:00100000:3.0:1762166778.738940:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbea80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166778.738945:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446807424 00000100:00100000:1.0:1762166778.739000:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1762166778.739009:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6495:x1847765446807424:12345-0@lo:104: 00010000:00010000:1.0:1762166778.739038:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166778.739129:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1762166778.739134:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6495:x1847765446807424:12345-0@lo:104: Request processed in 128us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166778.739140:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446807424:0@lo:104: 00000100:00100000:1.0:1762166778.739149:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1762166778.739153:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166778.739167:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.739176:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166778.739179:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad000 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:2.0:1762166778.739187:0:7420:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166778.739198:0:7420:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.739231:0:7420:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.739237:0:7420:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166778.739263:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.739271:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945cf3cad000/0x2f180c4effb0bb53 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0bb5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166778.739275:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1762166778.739289:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166778.739291:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446807552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166778.739292:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166778.739296:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166778.739335:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166778.739368:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446807552 00000100:00100000:2.0:1762166778.739373:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446807552 00010000:00010000:2.0:1762166778.739392:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0bb5a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0bb53 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166778.739418:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1762166778.739427:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446807552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166778.739437:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1762166778.740743:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967438 is committed 00010000:00010000:2.0:1762166778.740823:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0bb5a lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0bb53 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166778.740835:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166778.740839:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166778.740847:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166778.740860:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166778.740885:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166778.740916:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.740924:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166778.740929:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446807552:12345-0@lo:103:ldlm_bl.0 Request processed in 1502us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166778.740940:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1762166778.740956:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446807552:0@lo:103:ldlm_bl.0 00000004:00200000:3.0:1762166778.740957:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1762166778.740963:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1762166778.740987:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6800/0x2f180c4effb0bb99 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b08 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.740997:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b08 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.741002:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc477f700) 00010000:00010000:3.0:1762166778.741004:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166778.741006:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6a00, rc 0) 00000100:00100000:3.0:1762166778.741038:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:43223:x1847765440062464:12345-192.168.204.38@tcp:101:rm.0 Request processed in 2282us (2361us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166778.741048:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2673 00000100:00100000:0.0:1762166778.742085:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.742113:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440062592 00000100:00100000:3.0:1762166778.742117:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440062592 00000100:00100000:3.0:1762166778.742141:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2674 00000100:00100000:3.0:1762166778.742146:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:43223:x1847765440062592:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166778.742155:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.742165:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bba7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b0f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.742197:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742203:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742208:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742217:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742221:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742224:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742257:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742261:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742272:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742275:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742278:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.742281:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742285:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742290:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166778.742292:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.742294:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742298:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbae lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742305:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742308:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742311:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742314:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.742316:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742324:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742328:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:3.0:1762166778.742329:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.742331:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742334:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbb5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.742348:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bba7 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b0f expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.742353:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166778.742355:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.742356:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bba7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b0f expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.742361:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7e00, rc 0) 00000100:00100000:3.0:1762166778.742385:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:43223:x1847765440062592:12345-192.168.204.38@tcp:101:rm.0 Request processed in 239us (303us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166778.742389:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2674 00000100:00100000:0.0:1762166778.748785:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.748828:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440062848 00000100:00100000:3.0:1762166778.748837:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440062848 00000100:00100000:3.0:1762166778.748882:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2675 00000100:00100000:3.0:1762166778.748893:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:43224:x1847765440062848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166778.748910:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.748924:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166778.748945:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bb92 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b01 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.748961:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166778.748965:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166778.748976:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bbbc lrc: 2/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b16 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.749059:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749070:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749081:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749095:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749101:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749108:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749454:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749464:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749471:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166778.749511:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x4:0x0]: returning size 0 00010000:00010000:3.0:1762166778.749535:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749542:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749547:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749553:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749559:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.749563:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749569:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749577:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166778.749580:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.749597:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749603:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bbc3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00010000:3.0:1762166778.749613:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003414c1e8 reply state 00000000c1aadc3e transno 4294968891 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749622:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.749638:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:3.0:1762166778.749641:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166778.749643:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166778.749665:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bbbc lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.749678:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.749685:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc580af00) 00010000:00010000:3.0:1762166778.749688:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166778.749690:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6800, rc 0) 00000100:00100000:3.0:1762166778.749748:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:43224:x1847765440062848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 857us (968us total) trans 4294968891 rc 0/0 00000100:00100000:3.0:1762166778.749760:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2675 00000100:00100000:1.0:1762166778.751209:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.751293:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440063104 00000100:00100000:3.0:1762166778.751299:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440063104 00000100:00100000:3.0:1762166778.751330:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2676 00000100:00100000:3.0:1762166778.751337:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:43224:x1847765440063104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166778.751349:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.751359:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6000/0x2f180c4effb0bbdf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b1d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.751414:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.751425:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.751441:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.751464:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.751473:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 17 pid: 6495 timeout: 497 lvb_type: 0 00000100:00100000:3.0:1762166778.751526:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446807680:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166778.751610:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166778.752448:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446807680:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166778.752464:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166778.752700:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166778.752745:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440063232 00000100:00100000:2.0:1762166778.752751:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440063232 00010000:00010000:2.0:1762166778.752777:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 18 pid: 6495 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1762166778.752802:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 631 00000100:00100000:2.0:1762166778.752810:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440063232:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166778.752820:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166778.752826:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 18 pid: 6495 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1762166778.752837:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 18 pid: 6495 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1762166778.752851:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6800/0x2f180c4effb0bbd1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b16 expref: 18 pid: 6495 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1762166778.752862:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc580af00) 00010000:00010000:2.0:1762166778.752866:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.752873:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.752886:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166778.752905:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166778.752916:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.752926:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166778.752936:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440063232:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (237us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166778.752939:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x4:0x0]: returning size 0 00000100:00100000:2.0:1762166778.752946:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 631 00000004:00080000:3.0:1762166778.753129:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x48:0x0], index 0: 0 00010000:00010000:3.0:1762166778.753211:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.753220:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.753226:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.753237:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.753241:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.753248:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.753257:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc580af00) 00010000:00010000:3.0:1762166778.753260:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166778.753263:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.753269:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbe6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.753299:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6000/0x2f180c4effb0bbdf lrc: 1/0,0 mode: --/CR res: [0x200000405:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b1d expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.753308:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc580af00) 00010000:00010000:3.0:1762166778.753311:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166778.753314:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6000/0x2f180c4effb0bbdf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b1d expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.753327:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6000, rc 0) 00000100:00100000:3.0:1762166778.753364:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:43224:x1847765440063104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2026us (2156us total) trans 4294968892 rc 301/301 00000100:00100000:3.0:1762166778.753371:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2676 00000100:00100000:1.0:1762166778.754407:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166778.754464:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440063488 00000100:00100000:0.0:1762166778.754470:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440063488 00000100:00100000:0.0:1762166778.754526:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 768 00000100:00100000:0.0:1762166778.754532:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:43224:x1847765440063488:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166778.754681:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:43224:x1847765440063488:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 148us (275us total) trans 4294968893 rc 0/0 00000100:00100000:0.0:1762166778.754686:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 768 00000100:00100000:0.0:1762166778.756051:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166778.756126:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440063744 00000100:00100000:2.0:1762166778.756142:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440063744 00000100:00100000:2.0:1762166778.756210:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 769 00000100:00100000:2.0:1762166778.756239:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:43224:x1847765440063744:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166778.756504:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:43224:x1847765440063744:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 241us (424us total) trans 4294968894 rc 0/0 00000100:00100000:2.0:1762166778.756515:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 769 00000100:00100000:2.0:1762166778.762266:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.762346:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440063872 00000100:00100000:3.0:1762166778.762358:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440063872 00000100:00100000:3.0:1762166778.762404:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2677 00000100:00100000:3.0:1762166778.762428:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:43225:x1847765440063872:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1762166778.762444:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.762459:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0bbf4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b24 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.762547:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.762558:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762565:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762573:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.762578:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762581:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762653:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762657:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762660:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762664:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762675:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.762678:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762682:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762690:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc477f700) 00010000:00010000:3.0:1762166778.762692:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.762695:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762700:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7800/0x2f180c4effb0bbfb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762712:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762718:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762723:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762728:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.762731:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762736:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762742:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580af00) 00010000:00010000:3.0:1762166778.762745:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.762752:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762758:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc02 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.762790:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0bbf4 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b24 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.762799:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc477f700) 00010000:00010000:3.0:1762166778.762801:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.762804:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0bbf4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b24 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.762812:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6000, rc 0) 00000100:00100000:3.0:1762166778.762869:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:43225:x1847765440063872:12345-192.168.204.38@tcp:101:rm.0 Request processed in 446us (616us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166778.762876:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2677 00000100:00100000:1.0:1762166778.770155:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.770219:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440064128 00000100:00100000:3.0:1762166778.770230:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440064128 00000100:00100000:3.0:1762166778.770278:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2678 00000100:00100000:3.0:1762166778.770284:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:43226:x1847765440064128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166778.770306:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.770323:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6000/0x2f180c4effb0bc09 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b2b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.770390:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770400:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770418:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770425:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770429:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770433:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770533:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bc1e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770538:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bc1e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770542:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bc1e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166778.770549:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x4:0x0]: returning size 0 00010000:00010000:3.0:1762166778.770633:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770640:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770646:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770653:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770658:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.770668:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770673:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770681:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166778.770684:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.770686:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770690:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bc10 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770699:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770704:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770709:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770714:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.770716:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770722:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770729:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:3.0:1762166778.770731:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.770733:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770743:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bc17 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.770770:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6000/0x2f180c4effb0bc09 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b2b expref: 21 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.770778:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bc1e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b2b expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.770784:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc580af00) 00010000:00010000:3.0:1762166778.770785:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166778.770786:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6200, rc 0) 00000100:00100000:3.0:1762166778.770831:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:43226:x1847765440064128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 548us (686us total) trans 4294968895 rc 0/0 00000100:00100000:3.0:1762166778.770836:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2678 00000100:00100000:0.0:1762166778.772379:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166778.772459:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440064256 00000100:00100000:2.0:1762166778.772471:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440064256 00000100:00080000:0.0:1762166778.772558:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166778.772607:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 975 00000100:00100000:2.0:1762166778.772619:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+7:2417:x1847765440064256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166778.772638:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166778.772662:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b32 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166778.772689:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166778.772725:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166778.772729:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166778.772744:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 8 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166778.772775:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 8 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166778.772789:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cade00, rc 0) 00000100:00100000:2.0:1762166778.772849:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2417:x1847765440064256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 231us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166778.772857:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 975 00000100:00100000:2.0:1762166778.773866:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166778.773910:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440064512 00000100:00100000:0.0:1762166778.773917:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440064512 00000100:00100000:0.0:1762166778.773951:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 770 00000100:00100000:0.0:1762166778.773956:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:43226:x1847765440064512:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166778.774092:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:43226:x1847765440064512:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 135us (227us total) trans 4294968896 rc 0/0 00000100:00100000:0.0:1762166778.774097:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 770 00000100:00100000:1.0:1762166778.775385:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166778.775424:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440064768 00000100:00100000:3.0:1762166778.775431:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440064768 00000100:00100000:3.0:1762166778.775470:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2679 00000100:00100000:3.0:1762166778.775513:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:43226:x1847765440064768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166778.775528:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166778.775532:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166778.775556:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bba0 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b08 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.775573:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc477f700) 00010000:00010000:3.0:1762166778.775596:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166778.775610:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bc33 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b39 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.775704:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.775713:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.775719:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.775726:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.775730:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.775734:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776025:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166778.776031:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776035:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166778.776041:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 0 00010000:00010000:3.0:1762166778.776058:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776062:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776076:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776082:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776087:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166778.776091:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776098:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776106:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc580a100) 00010000:00010000:3.0:1762166778.776109:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166778.776112:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776117:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6600/0x2f180c4effb0bc3a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00010000:3.0:1762166778.776126:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d42b7b8c reply state 00000000d8f705bc transno 4294967439 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776135:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166778.776140:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:3.0:1762166778.776143:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166778.776145:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166778.776165:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bc33 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.776189:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166778.776196:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc580a200) 00010000:00010000:3.0:1762166778.776198:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166778.776200:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7400, rc 0) 00000100:00100000:3.0:1762166778.776248:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:43226:x1847765440064768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 772us (865us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1762166778.776256:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2679 00000100:00100000:3.0:1762166778.777666:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166778.777743:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440065024 00000100:00100000:0.0:1762166778.777751:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440065024 00000100:00100000:0.0:1762166778.777796:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2680 00000100:00100000:0.0:1762166778.777805:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:43226:x1847765440065024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.777822:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.777834:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bc56 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b40 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.777908:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.777920:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.777941:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.777983:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.777999:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 16 pid: 6495 timeout: 497 lvb_type: 0 00000100:00100000:0.0:1762166778.778012:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446807808:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166778.778094:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166778.779032:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446807808:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166778.779047:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166778.779191:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166778.779385:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440065152 00000100:00100000:2.0:1762166778.779391:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440065152 00010000:00010000:2.0:1762166778.779412:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 17 pid: 6495 timeout: 497 lvb_type: 0 00000100:00100000:2.0:1762166778.779439:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 632 00000100:00100000:2.0:1762166778.779446:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440065152:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166778.779456:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166778.779461:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 17 pid: 6495 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1762166778.779472:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 17 pid: 6495 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1762166778.779510:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7400/0x2f180c4effb0bc48 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b39 expref: 17 pid: 6495 timeout: 497 lvb_type: 0 00010000:00010000:2.0:1762166778.779526:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc580a200) 00010000:00010000:2.0:1762166778.779538:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166778.779546:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166778.779555:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166778.779590:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166778.779631:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440065152:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166778.779640:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 632 00010000:00010000:0.0:1762166778.779745:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.779754:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166778.779772:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 0 00000004:00080000:0.0:1762166778.779911:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1a:0x0], index 1: 0 00010000:00010000:0.0:1762166778.779998:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.780006:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.780012:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.780024:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166778.780028:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.780035:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.780044:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc580a200) 00010000:00010000:0.0:1762166778.780047:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166778.780050:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.780056:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc5d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166778.780090:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bc56 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b40 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.780099:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc580a200) 00010000:00010000:0.0:1762166778.780101:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166778.780105:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bc56 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b40 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.780119:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5a00, rc 0) 00000100:00100000:0.0:1762166778.780152:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:43226:x1847765440065024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2349us (2488us total) trans 4294967440 rc 301/301 00000100:00100000:0.0:1762166778.780159:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2680 00000100:00100000:3.0:1762166778.781024:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166778.781085:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440065408 00000100:00100000:0.0:1762166778.781090:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440065408 00000100:00100000:0.0:1762166778.781129:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 771 00000100:00100000:0.0:1762166778.781145:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:43226:x1847765440065408:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166778.781294:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:43226:x1847765440065408:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 150us (270us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1762166778.781301:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 771 00000100:00100000:2.0:1762166778.782090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166778.782136:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440065664 00000100:00100000:0.0:1762166778.782141:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440065664 00000100:00100000:0.0:1762166778.782170:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 772 00000100:00100000:0.0:1762166778.782178:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:43226:x1847765440065664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166778.782265:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:43226:x1847765440065664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 87us (175us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1762166778.782272:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 772 00000100:00100000:1.0:1762166778.793865:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166778.793935:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440065920 00000100:00100000:0.0:1762166778.793946:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440065920 00000100:00100000:0.0:1762166778.794002:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2681 00000100:00100000:0.0:1762166778.794012:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:43229:x1847765440065920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166778.794035:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166778.794053:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bc6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b47 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166778.794187:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1762166778.794269:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bc6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b47 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.794283:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166778.794286:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166778.794291:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bc6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b47 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166778.794313:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5a00, rc 0) 00000100:00100000:0.0:1762166778.794364:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:43229:x1847765440065920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 354us (505us total) trans 4294968897 rc 301/301 00000100:00100000:0.0:1762166778.794372:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2681 00000100:00100000:3.0:1762166778.795564:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166778.795602:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440066048 00000100:00100000:0.0:1762166778.795608:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440066048 00000100:00100000:0.0:1762166778.795642:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2682 00000100:00100000:0.0:1762166778.795649:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:43229:x1847765440066048:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166778.795687:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795699:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795710:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795720:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795726:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795732:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795783:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795791:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795803:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166778.795830:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x4:0x0]: returning size 0 00000004:00200000:0.0:1762166778.795833:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166778.795841:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795851:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795858:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795863:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795869:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795874:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166778.795878:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795885:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795894:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166778.795896:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.795900:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795906:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc79 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795925:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795930:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795936:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795940:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166778.795942:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795948:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795954:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166778.795956:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.795958:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795963:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc80 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795971:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795977:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795982:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.795987:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166778.795995:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.796001:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.796008:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc580af00) 00010000:00010000:0.0:1762166778.796011:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166778.796014:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166778.796019:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc87 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166778.796065:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:43229:x1847765440066048:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 415us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166778.796072:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2682 00000100:00100000:2.0:1762166778.797202:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166778.797241:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440066304 00000100:00100000:0.0:1762166778.797246:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440066304 00000100:00100000:0.0:1762166778.797277:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 773 00000100:00100000:0.0:1762166778.797285:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:43229:x1847765440066304:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166778.797391:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:43229:x1847765440066304:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 106us (190us total) trans 4294968898 rc 0/0 00000100:00100000:0.0:1762166778.797398:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 773 00000100:00100000:1.0:1762166779.148963:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166779.149017:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166779.149080:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440066432 00000100:00100000:2.0:1762166779.149085:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440066560 00000100:00100000:2.0:1762166779.149092:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440066560 00000100:00100000:0.0:1762166779.149092:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440066432 00000100:00080000:1.0:1762166779.149149:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166779.149150:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 242 00000100:00100000:0.0:1762166779.149158:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 600 00000100:00100000:2.0:1762166779.149163:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2416:x1847765440066560:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166779.149175:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765440066432:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166779.149227:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2416:x1847765440066560:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 66us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166779.149230:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765440066432:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 59us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166779.149237:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 242 00000100:00100000:0.0:1762166779.149254:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 600 00010000:00010000:0.0:1762166779.666733:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166780.058665:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166780.058749:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440066816 00000100:00100000:0.0:1762166780.058763:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440066816 00000100:00080000:1.0:1762166780.058839:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166780.058869:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2683 00000100:00100000:0.0:1762166780.058881:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:43590:x1847765440066816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166780.058908:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166780.058931:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc8e lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b4e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166780.059019:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166780.059031:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059043:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059050:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166780.059056:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059062:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059158:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059166:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059190:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059195:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059202:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166780.059206:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059214:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059227:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166780.059230:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166780.059235:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059242:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bc95 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059257:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059264:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059268:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059274:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166780.059277:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059293:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059301:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166780.059304:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166780.059307:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059313:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bc9c lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.059343:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc8e lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b4e expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166780.059352:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166780.059354:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166780.059356:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bc8e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b4e expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166780.059367:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4c00, rc 0) 00000100:00100000:0.0:1762166780.059432:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:43590:x1847765440066816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 553us (778us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166780.059440:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2683 00000100:00100000:1.0:1762166780.060731:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166780.060788:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440067072 00000100:00100000:0.0:1762166780.060801:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440067072 00000100:00100000:0.0:1762166780.060853:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2684 00000100:00100000:0.0:1762166780.060863:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:43590:x1847765440067072:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:1.0:1762166780.060864:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1762166780.060883:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166780.060909:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b55 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166780.061057:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1762166780.061161:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bca3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b55 expref: 25 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166780.061173:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166780.061175:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166780.061180:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b55 expref: 25 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166780.061191:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5a00, rc 0) 00000100:00100000:0.0:1762166780.061231:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:43590:x1847765440067072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 370us (504us total) trans 4294968899 rc 301/301 00000100:00100000:0.0:1762166780.061238:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2684 00000100:00100000:1.0:1762166780.062109:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166780.062164:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440067200 00000100:00100000:0.0:1762166780.062171:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440067200 00000100:00100000:0.0:1762166780.062208:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2685 00000100:00100000:0.0:1762166780.062216:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:43590:x1847765440067200:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166780.062270:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166780.062282:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062292:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062304:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166780.062319:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062326:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062388:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166780.062396:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062403:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166780.062434:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 0 00000004:00200000:0.0:1762166780.062438:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166780.062447:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062456:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062461:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062465:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062468:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062471:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166780.062474:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062509:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062518:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166780.062521:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166780.062524:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062530:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcb1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062545:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062551:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062556:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062575:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166780.062578:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062584:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062592:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166780.062595:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166780.062597:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062602:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bcb8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062618:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062624:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062629:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062634:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166780.062637:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062643:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062650:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc403ae00) 00010000:00010000:0.0:1762166780.062652:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166780.062655:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166780.062660:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcbf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166780.062720:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:43590:x1847765440067200:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 503us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166780.062729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2685 00000100:00100000:3.0:1762166780.063691:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166780.063769:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440067456 00000100:00100000:0.0:1762166780.063774:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440067456 00000100:00100000:0.0:1762166780.063816:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 774 00000100:00100000:0.0:1762166780.063824:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:43590:x1847765440067456:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166780.064008:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:43590:x1847765440067456:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 184us (318us total) trans 4294968900 rc 0/0 00000100:00100000:0.0:1762166780.064013:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 774 00000100:00100000:0.0:1762166780.178794:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762166780.178796:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446808064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166780.178816:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446807936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1762166780.178888:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166780.178930:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166780.178977:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446807936 00000100:00100000:3.0:1762166780.178989:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446807936 00000100:00100000:1.0:1762166780.178993:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446808064 00000100:00100000:1.0:1762166780.179020:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446808064 00000100:00080000:0.0:1762166780.179052:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166780.179087:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1762166780.179099:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1762166780.179108:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446807936:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166780.179119:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446808064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1762166780.179147:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00002000:00000024:1.0:1762166780.179151:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1762166780.179228:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446808064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166780.179240:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1762166780.179261:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446807936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166780.179269:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446808064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166780.179277:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1762166780.179324:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446807936:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1762166780.690637:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166780.690699:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446808192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166780.690757:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166780.690817:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446808192 00000100:00100000:2.0:1762166780.690826:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446808192 00000100:00100000:2.0:1762166780.690883:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1762166780.690894:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446808192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1762166780.690934:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445957632 avail 1299718144 00000100:00100000:2.0:1762166780.690987:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446808192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166780.690995:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1762166780.691011:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446808192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166781.194578:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.194657:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440067712 00000100:00100000:0.0:1762166781.194672:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440067712 00000100:00100000:0.0:1762166781.194757:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2686 00000100:00100000:0.0:1762166781.194770:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:43949:x1847765440067712:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:0.0:1762166781.194845:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166781.194888:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6200/0x2f180c4effb0bc1e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b2b expref: 25 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.194910:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc580af00) 00010000:00010000:0.0:1762166781.194925:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.194950:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.194964:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.194973:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.194981:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195000:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195004:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195091:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195096:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195100:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000040:00080000:0.0:1762166781.195364:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].112, 64 off17208 00000004:00080000:0.0:1762166781.195376:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400343897880ns, next at 401343894034ns, rc = 0 00010000:00010000:0.0:1762166781.195430:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195436:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195442:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195447:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195460:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195466:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195532:0:6495:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166781.195563:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195568:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195572:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195576:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.195580:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166781.195581:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166781.195587:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166781.195592:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195595:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc403ae00) 00010000:00010000:0.0:1762166781.195603:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762166781.195608:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166781.195609:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166781.195615:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195618:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bcd4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166781.195627:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166781.195640:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x4:0x0].0x0 (ffff945bc403ae00) 00010000:00010000:1.0:1762166781.195642:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166781.195646:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 1/0,0 mode: --/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166781.195652:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bcdb lrc: 0/0,0 mode: --/PW res: [0x200000405:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166781.195669:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166781.195672:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166781.195674:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166781.195762:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195770:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195775:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195793:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195799:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.195803:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195809:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195818:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.195821:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.195825:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195830:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bcc6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166781.195840:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000057e11708 reply state 0000000056288cbf transno 4294968901 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195850:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.195856:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.195859:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166781.195862:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166781.195956:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:43949:x1847765440067712:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1188us (1389us total) trans 4294968901 rc 0/0 00000100:00100000:0.0:1762166781.195964:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2686 00000100:00100000:1.0:1762166781.202425:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.202515:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440067968 00000100:00100000:0.0:1762166781.202532:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440067968 00000100:00100000:0.0:1762166781.202603:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2687 00000100:00100000:0.0:1762166781.202618:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:43950:x1847765440067968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.202653:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166781.202661:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446808320:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1762166781.202680:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bce2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b5c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166781.202725:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166781.202814:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166781.202823:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446808320 00000100:00100000:1.0:1762166781.202828:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446808320 00010000:00010000:0.0:1762166781.202832:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.202848:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.202861:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.202867:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166781.202868:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00010000:00010000:0.0:1762166781.202876:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166781.202884:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446808320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1762166781.202912:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446227968 avail 1299988480 00000100:00100000:1.0:1762166781.202967:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446808320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.202974:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1762166781.202987:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967438 gen 2 00000004:00080000:3.0:1762166781.202993:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967438 committed transno 4294967438 00000100:00100000:3.0:1762166781.203024:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446808320:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1762166781.203318:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203328:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203335:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.203357:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 0 00010000:00010000:0.0:1762166781.203390:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203398:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203404:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203410:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203416:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.203421:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203428:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203441:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.203443:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.203448:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203454:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bce9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166781.203465:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000007dae825 reply state 00000000d0110dc3 transno 4294968902 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203501:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.203517:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.203519:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166781.203521:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166781.203561:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bce2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 29 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.203574:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 28 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.203581:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.203583:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.203586:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5400, rc 0) 00000100:00100000:0.0:1762166781.203637:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:43950:x1847765440067968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1025us (1223us total) trans 4294968902 rc 0/0 00000100:00100000:0.0:1762166781.203644:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2687 00000100:00100000:3.0:1762166781.205034:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.205081:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440068224 00000100:00100000:0.0:1762166781.205088:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440068224 00000100:00100000:0.0:1762166781.205132:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2688 00000100:00100000:0.0:1762166781.205142:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:43950:x1847765440068224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.205159:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.205173:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bd05 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b63 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.205252:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.205265:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.205284:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.205316:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.205330:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 30 pid: 6495 timeout: 500 lvb_type: 0 00000100:00100000:0.0:1762166781.205342:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446808448:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166781.205417:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166781.206275:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446808448:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166781.206295:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166781.206413:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.206656:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440068352 00000100:00100000:2.0:1762166781.206673:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440068352 00010000:00010000:2.0:1762166781.206720:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 31 pid: 6495 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1762166781.206761:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 633 00000100:00100000:2.0:1762166781.206771:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440068352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166781.206786:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166781.206792:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 31 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.206805:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 31 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.206839:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bcf7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b5c expref: 31 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.206855:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:2.0:1762166781.206860:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.206868:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.206875:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.206919:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.206952:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.206963:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166781.206980:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765440068352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (566us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166781.206986:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 0 00000100:00100000:2.0:1762166781.206994:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 633 00000004:00080000:0.0:1762166781.207147:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x43:0x0], index 1: 0 00000004:00080000:0.0:1762166781.207155:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x49:0x0], index 0: 0 00010000:00010000:0.0:1762166781.207252:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.207261:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.207284:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.207290:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.207295:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.207304:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.207317:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.207320:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166781.207324:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.207341:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd0c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.207386:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bd05 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b63 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.207397:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.207399:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166781.207403:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bd05 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b63 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.207417:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5000, rc 0) 00000100:00100000:0.0:1762166781.207461:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:43950:x1847765440068224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2321us (2431us total) trans 4294968903 rc 301/301 00000100:00100000:0.0:1762166781.207470:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2688 00000100:00100000:3.0:1762166781.208652:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.208711:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440068608 00000100:00100000:0.0:1762166781.208716:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440068608 00000100:00100000:0.0:1762166781.208757:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 775 00000100:00100000:0.0:1762166781.208768:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:43950:x1847765440068608:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.208999:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:43950:x1847765440068608:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 234us (350us total) trans 4294968904 rc 0/0 00000100:00100000:0.0:1762166781.209008:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 775 00000100:00100000:1.0:1762166781.210182:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.210233:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440068736 00000100:00100000:0.0:1762166781.210239:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440068736 00000100:00100000:0.0:1762166781.210280:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2689 00000100:00100000:0.0:1762166781.210290:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:43950:x1847765440068736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.210302:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.210324:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0bd1a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b6a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.210363:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0bd1a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b6a expref: 31 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.210375:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0bd1a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b6a expref: 31 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.210390:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.210393:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166781.210396:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5c00, rc 0) 00000100:00100000:0.0:1762166781.210433:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:43950:x1847765440068736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 146us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.210441:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2689 00000100:00100000:1.0:1762166781.211469:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.211564:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440068992 00000100:00100000:0.0:1762166781.211570:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440068992 00000100:00100000:0.0:1762166781.211602:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 776 00000100:00100000:0.0:1762166781.211611:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:43950:x1847765440068992:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.211727:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:43950:x1847765440068992:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 117us (259us total) trans 4294968905 rc 0/0 00000100:00100000:0.0:1762166781.211734:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 776 00000100:00100000:3.0:1762166781.216693:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.216755:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440069120 00000100:00100000:0.0:1762166781.216766:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440069120 00000100:00100000:0.0:1762166781.216832:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2690 00000100:00100000:0.0:1762166781.216845:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:43951:x1847765440069120:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:0.0:1762166781.216868:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.216894:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bd21 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b71 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.216985:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.217019:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217034:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217046:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.217054:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217060:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217179:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bd36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.217187:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bd36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217194:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bd36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166781.217241:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 0 00000004:00200000:0.0:1762166781.217246:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166781.217267:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bd36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217279:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bd36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217288:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217295:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217303:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217309:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217315:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.217319:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217327:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217358:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.217362:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.217367:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217374:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bd28 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217384:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217388:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217391:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217394:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.217396:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217398:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217402:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.217404:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.217405:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217408:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bd2f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.217428:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bd21 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b71 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.217453:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bd36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b71 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.217460:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.217462:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.217465:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:0.0:1762166781.217644:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:43951:x1847765440069120:12345-192.168.204.38@tcp:101:rm.0 Request processed in 801us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.217655:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2690 00000100:00100000:1.0:1762166781.219004:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.219061:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440069248 00000100:00100000:2.0:1762166781.219069:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440069248 00000100:00080000:0.0:1762166781.219125:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166781.219136:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 976 00000100:00100000:2.0:1762166781.219146:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2419:x1847765440069248:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166781.219161:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166781.219180:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b78 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166781.219288:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166781.219305:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166781.219307:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166781.219315:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166781.219329:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166781.219338:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cacc00, rc 0) 00000100:00100000:2.0:1762166781.219374:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+7:2419:x1847765440069248:12345-192.168.204.38@tcp:101:rm.0 Request processed in 231us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166781.219379:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 976 00000100:00100000:2.0:1762166781.220437:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.220493:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440069504 00000100:00100000:0.0:1762166781.220500:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440069504 00000100:00100000:0.0:1762166781.220533:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2691 00000100:00100000:0.0:1762166781.220551:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:43951:x1847765440069504:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:0.0:1762166781.220598:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166781.220619:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bd36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b71 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.220631:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.220638:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.220656:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.220665:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.220671:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.220694:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.220699:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.220703:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.220766:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.220771:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.220774:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:0.0:1762166781.221052:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 64 off9032 00000004:00080000:0.0:1762166781.221067:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 400369588330ns, next at 401369583750ns, rc = 0 00010000:00010000:0.0:1762166781.221133:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.221143:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221151:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221157:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221163:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221180:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221205:0:6495:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166781.221224:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221231:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166781.221237:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166781.221237:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166781.221246:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221248:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166781.221256:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166781.221256:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166781.221262:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221269:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166781.221272:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221281:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc403a700) 00010000:00010000:0.0:1762166781.221286:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762166781.221289:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221295:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bd52 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166781.221296:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff945bc403a700) 00010000:00010000:1.0:1762166781.221305:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166781.221309:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166781.221316:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd59 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166781.221341:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166781.221343:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166781.221345:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166781.221432:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221440:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221456:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221461:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221466:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.221470:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221500:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221510:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403a000) 00010000:00010000:0.0:1762166781.221513:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.221516:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221522:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bd44 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00010000:0.0:1762166781.221536:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000031ce7aeb reply state 0000000035ad1e4d transno 4294967443 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221560:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.221566:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.221569:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166781.221572:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166781.221647:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:43951:x1847765440069504:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1105us (1211us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1762166781.221665:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2691 00000100:00100000:3.0:1762166781.229199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.229262:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440069760 00000100:00100000:0.0:1762166781.229276:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440069760 00000100:00100000:0.0:1762166781.229351:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2692 00000100:00100000:0.0:1762166781.229362:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:43952:x1847765440069760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.229389:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.229409:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0bd60 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b7f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.229557:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229570:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229580:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229588:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229593:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229598:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229712:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0bd75 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229716:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0bd75 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229738:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0bd75 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.229749:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 0 00010000:00010000:0.0:1762166781.229855:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229860:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229865:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229869:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229872:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.229875:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229883:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229897:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.229900:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.229905:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229912:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bd67 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229924:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229940:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229947:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229952:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.229955:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229961:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229967:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.229969:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.229971:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.229975:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bd6e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.230013:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0bd60 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b7f expref: 35 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.230026:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0bd75 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b7f expref: 34 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.230033:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.230034:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.230036:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3c00, rc 0) 00000100:00100000:0.0:1762166781.230095:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:43952:x1847765440069760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 736us (910us total) trans 4294968906 rc 0/0 00000100:00100000:0.0:1762166781.230106:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2692 00000100:00100000:1.0:1762166781.231608:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.231752:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440069888 00000100:00100000:3.0:1762166781.231777:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.231784:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440069888 00000100:00100000:1.0:1762166781.231836:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440070016 00000100:00100000:1.0:1762166781.231844:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440070016 00000100:00100000:2.0:1762166781.231874:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 977 00000100:00100000:2.0:1762166781.231892:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+7:2418:x1847765440069888:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:3.0:1762166781.231895:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1762166781.231917:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166781.231923:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 978 00000100:00100000:1.0:1762166781.231945:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440070016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166781.231946:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b86 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.231973:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1762166781.231978:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166781.231994:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b8d expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166781.232002:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166781.232008:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166781.232020:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 8 pid: 28874 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1762166781.232023:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166781.232052:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166781.232054:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 8 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166781.232057:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.232068:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 9 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166781.232086:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00010000:00010000:1.0:1762166781.232091:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 9 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166781.232106:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0200, rc 0) 00000100:00100000:1.0:1762166781.232172:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440070016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 234us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166781.232173:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440069888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 282us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.232196:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 978 00000100:00100000:2.0:1762166781.232210:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 977 00000100:00100000:1.0:1762166781.233318:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.233373:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440070272 00000100:00100000:0.0:1762166781.233387:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440070272 00000100:00100000:0.0:1762166781.233431:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 777 00000100:00100000:0.0:1762166781.233441:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:43952:x1847765440070272:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.233699:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:43952:x1847765440070272:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 259us (383us total) trans 4294968907 rc 0/0 00000100:00100000:0.0:1762166781.233706:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 777 00000100:00100000:3.0:1762166781.234910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.234962:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440070400 00000100:00100000:0.0:1762166781.234968:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440070400 00000100:00100000:0.0:1762166781.235007:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2693 00000100:00100000:0.0:1762166781.235015:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:43952:x1847765440070400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.235041:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.235063:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0bd91 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b94 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.235132:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.235145:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235156:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235168:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.235176:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235200:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235242:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235249:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235255:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235262:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235268:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.235273:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235280:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235294:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403a000) 00010000:00010000:0.0:1762166781.235297:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.235301:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235308:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bd98 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235320:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235326:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235338:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235341:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.235344:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235347:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235352:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.235353:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.235355:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235357:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0bd9f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.235378:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0bd91 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b94 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.235390:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403a000) 00010000:00010000:0.0:1762166781.235392:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.235395:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2800/0x2f180c4effb0bd91 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b94 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.235405:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2800, rc 0) 00000100:00100000:0.0:1762166781.235437:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:43952:x1847765440070400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 424us (532us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166781.235442:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2693 00000100:00100000:3.0:1762166781.236673:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.236712:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440070656 00000100:00100000:0.0:1762166781.236717:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440070656 00000100:00100000:0.0:1762166781.236748:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2694 00000100:00100000:0.0:1762166781.236753:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:43952:x1847765440070656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.236764:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.236777:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0bda6 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7b9b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.236849:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.236859:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.236868:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.236878:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.236885:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.236890:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237286:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.237296:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237303:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166781.237328:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x6:0x0]: returning size 0 00010000:00010000:0.0:1762166781.237355:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237361:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237367:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237373:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237389:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.237397:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237403:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237413:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.237415:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.237419:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237425:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0bdad lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00010000:0.0:1762166781.237437:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d37fad52 reply state 000000008e1e88fc transno 4294967444 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237447:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.237463:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.237465:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166781.237468:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166781.237518:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0bda6 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 22 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.237535:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 21 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.237555:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.237558:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.237560:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4800, rc 0) 00000100:00100000:0.0:1762166781.237614:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:43952:x1847765440070656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 860us (945us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1762166781.237622:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2694 00000100:00100000:1.0:1762166781.239102:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.239164:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440070912 00000100:00100000:0.0:1762166781.239173:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440070912 00000100:00100000:0.0:1762166781.239219:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2695 00000100:00100000:0.0:1762166781.239229:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:43952:x1847765440070912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.239250:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.239266:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bdc9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ba2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.239358:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.239373:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.239404:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.239441:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.239456:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 23 pid: 6495 timeout: 500 lvb_type: 0 00000100:00100000:0.0:1762166781.239473:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446808576:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166781.239609:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166781.240437:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446808576:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166781.240459:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166781.240741:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.240834:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440071040 00000100:00100000:2.0:1762166781.240845:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440071040 00010000:00010000:2.0:1762166781.240880:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 24 pid: 6495 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1762166781.240915:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 634 00000100:00100000:2.0:1762166781.240925:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440071040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166781.240940:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166781.240959:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 24 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.240972:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 24 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.240993:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bdbb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b9b expref: 24 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.241009:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:2.0:1762166781.241012:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.241018:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.241023:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.241051:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.241097:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166781.241100:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440071040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166781.241126:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 634 00010000:00010000:0.0:1762166781.241127:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166781.241157:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x6:0x0]: returning size 0 00000004:00080000:0.0:1762166781.241294:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1b:0x0], index 1: 0 00000004:00080000:0.0:1762166781.241301:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1d:0x0], index 0: 0 00010000:00010000:0.0:1762166781.241395:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.241403:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.241425:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.241430:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.241434:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.241442:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.241456:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.241459:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166781.241463:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.241468:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdd0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.241561:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bdc9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ba2 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.241571:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.241573:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166781.241577:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0bdc9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ba2 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.241593:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5a00, rc 0) 00000100:00100000:0.0:1762166781.241654:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:43952:x1847765440070912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2426us (2567us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1762166781.241664:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2695 00000100:00100000:1.0:1762166781.242738:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.242788:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440071296 00000100:00100000:0.0:1762166781.242797:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440071296 00000100:00100000:0.0:1762166781.242846:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 778 00000100:00100000:0.0:1762166781.242855:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:43952:x1847765440071296:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.243005:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:43952:x1847765440071296:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 150us (272us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1762166781.243012:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 778 00000100:00100000:3.0:1762166781.243839:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.243882:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440071552 00000100:00100000:0.0:1762166781.243888:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440071552 00000100:00100000:0.0:1762166781.243918:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 779 00000100:00100000:0.0:1762166781.243926:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:43952:x1847765440071552:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.244016:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:43952:x1847765440071552:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 90us (180us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1762166781.244024:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 779 00000100:00100000:3.0:1762166781.253824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.253873:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440071808 00000100:00100000:0.0:1762166781.253886:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440071808 00000100:00100000:0.0:1762166781.253948:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2696 00000100:00100000:0.0:1762166781.253958:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:43955:x1847765440071808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.253977:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.253995:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ba9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166781.254126:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1762166781.254198:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ba9 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.254209:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166781.254223:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166781.254226:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bdde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ba9 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.254235:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:0.0:1762166781.254290:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:43955:x1847765440071808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 335us (482us total) trans 4294968908 rc 301/301 00000100:00100000:0.0:1762166781.254296:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2696 00000100:00100000:1.0:1762166781.255280:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.255320:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440071936 00000100:00100000:0.0:1762166781.255325:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440071936 00000100:00100000:0.0:1762166781.255355:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2697 00000100:00100000:0.0:1762166781.255363:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:43955:x1847765440071936:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166781.255401:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255413:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255424:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255433:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255440:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255445:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255514:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255554:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255561:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.255587:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x5:0x0]: returning size 0 00000004:00200000:0.0:1762166781.255591:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166781.255599:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255610:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255615:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255620:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255625:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255630:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.255633:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255639:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255647:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.255649:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.255653:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255668:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0bdec lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255677:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255682:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255687:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255691:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.255694:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255699:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255707:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.255709:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.255712:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255716:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0bdf3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255724:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255730:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255735:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255745:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.255749:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255755:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255767:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.255769:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.255772:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 2/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.255778:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0bdfa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166781.255813:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:43955:x1847765440071936:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 452us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.255818:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2697 00000100:00100000:3.0:1762166781.256776:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.256823:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440072192 00000100:00100000:0.0:1762166781.256830:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440072192 00000100:00100000:0.0:1762166781.256871:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 780 00000100:00100000:0.0:1762166781.256881:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:43955:x1847765440072192:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.256993:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:43955:x1847765440072192:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 114us (226us total) trans 4294968909 rc 0/0 00000100:00100000:0.0:1762166781.257000:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 780 00000100:00100000:3.0:1762166781.377297:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.377364:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440072448 00000100:00100000:0.0:1762166781.377376:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440072448 00000100:00100000:0.0:1762166781.377436:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2698 00000100:00100000:0.0:1762166781.377449:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:43989:x1847765440072448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.377505:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.377526:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0be01 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bb0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.377602:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.377613:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377620:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377626:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.377631:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377635:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377684:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377688:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377691:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377695:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377699:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.377705:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377710:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377718:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.377720:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.377723:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377727:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be08 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377735:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377738:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377741:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377744:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.377745:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377748:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377752:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.377753:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.377754:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377763:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be0f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.377786:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0be01 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bb0 expref: 25 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.377794:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.377796:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166781.377800:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5600/0x2f180c4effb0be01 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bb0 expref: 25 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.377812:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5600, rc 0) 00000100:00100000:0.0:1762166781.377861:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:43989:x1847765440072448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 416us (571us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166781.377867:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2698 00000100:00100000:1.0:1762166781.378981:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.379027:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440072704 00000100:00100000:0.0:1762166781.379039:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440072704 00000100:00100000:0.0:1762166781.379074:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2699 00000100:00100000:0.0:1762166781.379082:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:43989:x1847765440072704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.379095:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.379106:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bb7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166781.379202:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1762166781.379281:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bb7 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.379292:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166781.379302:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166781.379307:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bb7 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.379317:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:0.0:1762166781.379351:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:43989:x1847765440072704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 270us (370us total) trans 4294968910 rc 301/301 00000100:00100000:0.0:1762166781.379358:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2699 00000100:00100000:3.0:1762166781.380286:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.380339:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440072832 00000100:00100000:0.0:1762166781.380343:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440072832 00000100:00100000:0.0:1762166781.380367:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2700 00000100:00100000:0.0:1762166781.380372:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:43989:x1847765440072832:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166781.380399:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.380406:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380411:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380417:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.380422:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380425:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380450:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.380462:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380466:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166781.380500:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x6:0x0]: returning size 0 00000004:00200000:0.0:1762166781.380503:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166781.380509:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380517:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380521:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380524:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380527:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380530:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.380532:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380546:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380551:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.380553:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.380555:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380565:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be24 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380576:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380581:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380586:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380591:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.380594:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380600:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380608:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.380610:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.380613:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380619:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be2b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380627:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380633:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380638:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380648:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.380650:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380654:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380659:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403a000) 00010000:00010000:0.0:1762166781.380660:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.380662:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.380665:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be32 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166781.380702:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:43989:x1847765440072832:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 330us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.380707:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2700 00000100:00100000:3.0:1762166781.381585:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.381629:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440073088 00000100:00100000:0.0:1762166781.381635:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440073088 00000100:00100000:0.0:1762166781.381669:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 781 00000100:00100000:0.0:1762166781.381677:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:43989:x1847765440073088:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.381799:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:43989:x1847765440073088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 122us (216us total) trans 4294968911 rc 0/0 00000100:00100000:0.0:1762166781.381806:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 781 00000100:00100000:1.0:1762166781.501855:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.502039:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440073344 00000100:00100000:0.0:1762166781.502054:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440073344 00000100:00100000:0.0:1762166781.502126:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2701 00000100:00100000:0.0:1762166781.502137:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44021:x1847765440073344:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:0.0:1762166781.502203:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166781.502240:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0bd75 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b7f expref: 39 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.502261:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0bd1a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b6a expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.502271:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.502280:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.502298:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502309:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502318:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502327:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502334:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502340:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502409:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502416:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502432:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000040:00080000:0.0:1762166781.502711:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].107, 64 off16792 00000004:00080000:0.0:1762166781.502721:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400651243027ns, next at 401651240703ns, rc = 0 00000040:00080000:0.0:1762166781.502753:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].113, 64 off17272 00010000:00010000:0.0:1762166781.502796:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502805:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502812:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502819:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502825:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502831:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502855:0:6495:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166781.502870:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502876:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502882:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.502897:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166781.502898:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.502911:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.502913:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.502945:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166781.502950:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.502951:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.502985:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.502990:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403a000) 00010000:00010000:0.0:1762166781.502994:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762166781.502998:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503032:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0be47 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.503043:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x5:0x0].0x0 (ffff945bc403a000) 00010000:00010000:2.0:1762166781.503049:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166781.503060:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 1/0,0 mode: --/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.503067:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be4e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.503089:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166781.503092:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166781.503095:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166781.503143:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503151:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503156:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503161:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503165:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.503168:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503173:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503194:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.503196:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.503199:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503205:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0be39 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166781.503213:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000012a827ee reply state 0000000026f46ca7 transno 4294968912 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503222:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.503228:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.503230:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166781.503233:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166781.503307:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44021:x1847765440073344:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1172us (1467us total) trans 4294968912 rc 0/0 00000100:00100000:0.0:1762166781.503315:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2701 00000100:00100000:3.0:1762166781.510278:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.510327:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440073472 00000100:00100000:0.0:1762166781.510339:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440073472 00000100:00100000:0.0:1762166781.510404:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2702 00000100:00100000:0.0:1762166781.510415:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44022:x1847765440073472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.510439:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.510459:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0be55 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bbe expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.510574:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510591:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510601:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510614:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510621:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510628:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510671:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510678:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510684:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510696:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510702:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.510706:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510714:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510735:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.510739:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.510743:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510750:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0be5c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510762:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510767:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510773:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510778:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.510781:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510787:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510794:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.510797:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.510799:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510804:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0be63 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.510831:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0be55 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bbe expref: 40 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.510843:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.510845:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.510848:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0be55 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bbe expref: 40 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.510854:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3c00, rc 0) 00000100:00100000:0.0:1762166781.510904:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44022:x1847765440073472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 493us (637us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166781.510909:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2702 00000100:00100000:3.0:1762166781.512250:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.512293:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440073600 00000100:00100000:0.0:1762166781.512299:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440073600 00000100:00100000:0.0:1762166781.512336:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2703 00000100:00100000:0.0:1762166781.512344:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44022:x1847765440073600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.512354:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.512363:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be6a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bc5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.512398:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512408:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512415:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512424:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512440:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512447:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512465:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512470:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512495:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512502:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512509:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.512513:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512518:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512530:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.512544:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.512548:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512555:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0be71 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512565:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512576:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512581:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512586:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.512589:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512595:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512602:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.512604:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.512607:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512612:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0be78 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.512630:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be6a lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bc5 expref: 40 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.512638:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.512640:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.512644:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0be6a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bc5 expref: 40 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.512651:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4800, rc 0) 00000100:00100000:0.0:1762166781.512683:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44022:x1847765440073600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 340us (435us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166781.512696:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2703 00000100:00100000:1.0:1762166781.513755:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.513788:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440073728 00000100:00100000:0.0:1762166781.513793:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440073728 00000100:00100000:0.0:1762166781.513828:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2704 00000100:00100000:0.0:1762166781.513837:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44022:x1847765440073728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.513847:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.513856:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0be7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bcc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.513889:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be86 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.513897:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.513904:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.513978:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1762166781.513983:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1762166781.513999:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.514016:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5600/0x2f180c4effb0be7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bcc expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.514028:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be86 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bcc expref: 40 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.514043:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166781.514057:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166781.514061:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb5000, rc 0) 00000100:00100000:0.0:1762166781.514094:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:44022:x1847765440073728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 258us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.514100:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2704 00000100:00100000:3.0:1762166781.515356:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.515391:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440073856 00000100:00100000:0.0:1762166781.515397:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440073856 00000100:00100000:0.0:1762166781.515426:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2705 00000100:00100000:0.0:1762166781.515435:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:44022:x1847765440073856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.515444:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.515452:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be8d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bd3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.515499:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be94 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.515509:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be94 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.515517:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be94 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.515549:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1762166781.515553:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1762166781.515572:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4c00/0x2f180c4effb0be8d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bd3 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.515585:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be94 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bd3 expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.515591:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.515599:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166781.515602:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3a00, rc 0) 00000100:00100000:0.0:1762166781.515632:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:44022:x1847765440073856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 199us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.515638:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2705 00000100:00100000:3.0:1762166781.516784:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.516827:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440073984 00000100:00100000:0.0:1762166781.516832:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440073984 00000100:00100000:0.0:1762166781.516866:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2706 00000100:00100000:0.0:1762166781.516877:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:44022:x1847765440073984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.516888:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.516902:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0be9b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bda expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.516947:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bea2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.516956:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bea2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.516964:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bea2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166781.516992:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1762166781.516996:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1762166781.517018:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0be9b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bda expref: 26 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.517031:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bea2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bda expref: 25 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.517039:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.517047:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166781.517049:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3600, rc 0) 00000100:00100000:0.0:1762166781.517082:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:44022:x1847765440073984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 208us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.517089:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2706 00000100:00100000:1.0:1762166781.519129:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.519165:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440074112 00000100:00100000:0.0:1762166781.519172:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440074112 00000100:00100000:0.0:1762166781.519208:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2707 00000100:00100000:0.0:1762166781.519217:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:44022:x1847765440074112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.519230:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.519242:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0bea9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7be1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.519299:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519311:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519319:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519330:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519337:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519343:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519374:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519390:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519396:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519402:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519407:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.519411:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519419:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519428:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.519431:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.519435:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519440:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0beb0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519450:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519455:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519461:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519466:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.519473:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519493:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519500:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.519502:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.519505:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519508:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5c00/0x2f180c4effb0beb7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.519529:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0bea9 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be1 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.519548:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.519550:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.519553:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0bea9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be1 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.519559:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2200, rc 0) 00000100:00100000:0.0:1762166781.519590:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:44022:x1847765440074112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 375us (462us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166781.519595:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2707 00000100:00100000:3.0:1762166781.520872:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.520930:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440074368 00000100:00100000:0.0:1762166781.520935:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440074368 00000100:00100000:0.0:1762166781.520974:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2708 00000100:00100000:0.0:1762166781.520985:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:44022:x1847765440074368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.521005:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.521008:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166781.521021:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0be94 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bd3 expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.521034:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.521038:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.521046:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bebe lrc: 2/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7be8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.521099:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521109:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521117:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521125:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521133:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521139:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521499:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521507:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521523:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.521543:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x6:0x0]: returning size 0 00010000:00010000:0.0:1762166781.521567:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521574:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521579:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521585:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521589:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.521592:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521598:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521605:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.521607:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.521610:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521616:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4200/0x2f180c4effb0bec5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166781.521624:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009bd55daf reply state 000000008db472b3 transno 4294968913 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521645:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.521651:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.521653:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166781.521655:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166781.521676:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4800/0x2f180c4effb0bebe lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.521688:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.521694:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x6:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.521696:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.521698:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89200, rc 0) 00000100:00100000:0.0:1762166781.521739:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:44022:x1847765440074368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 758us (870us total) trans 4294968913 rc 0/0 00000100:00100000:0.0:1762166781.521747:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2708 00000100:00100000:3.0:1762166781.523295:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.523361:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440074624 00000100:00100000:0.0:1762166781.523368:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440074624 00000100:00100000:0.0:1762166781.523402:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2709 00000100:00100000:0.0:1762166781.523410:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:44022:x1847765440074624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.523425:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.523433:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0bee1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bef expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.523516:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.523549:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.523557:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.523590:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.523604:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 44 pid: 6495 timeout: 500 lvb_type: 0 00000100:00100000:0.0:1762166781.523617:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446808704:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166781.523698:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166781.524785:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446808704:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166781.524805:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166781.524865:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.524954:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440074752 00000100:00100000:2.0:1762166781.524969:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440074752 00010000:00010000:2.0:1762166781.525018:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 45 pid: 6495 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1762166781.525068:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 635 00000100:00100000:2.0:1762166781.525078:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440074752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166781.525096:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166781.525104:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 45 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.525121:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 45 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.525155:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0bed3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7be8 expref: 45 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.525173:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x6:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166781.525191:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.525199:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.525204:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166781.525225:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.525250:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.525259:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.525272:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x6:0x0]: returning size 0 00000100:00100000:2.0:1762166781.525293:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440074752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 211us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166781.525305:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 635 00000004:00080000:0.0:1762166781.525413:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4a:0x0], index 0: 0 00000004:00080000:0.0:1762166781.525420:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x44:0x0], index 1: 0 00010000:00010000:0.0:1762166781.525524:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.525556:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.525562:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.525567:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.525571:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.525578:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.525589:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x6:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.525592:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166781.525596:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.525601:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0bee8 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.525641:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0bee1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bef expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.525649:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x6:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.525651:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166781.525655:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0bee1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bef expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.525667:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89e00, rc 0) 00000100:00100000:0.0:1762166781.525706:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:44022:x1847765440074624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2297us (2412us total) trans 4294968914 rc 301/301 00000100:00100000:0.0:1762166781.525720:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2709 00000100:00100000:3.0:1762166781.526750:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.526799:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440075008 00000100:00100000:0.0:1762166781.526806:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440075008 00000100:00100000:0.0:1762166781.526846:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 782 00000100:00100000:0.0:1762166781.526854:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:44022:x1847765440075008:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.527013:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:44022:x1847765440075008:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 159us (264us total) trans 4294968915 rc 0/0 00000100:00100000:0.0:1762166781.527020:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 782 00000100:00100000:1.0:1762166781.527829:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.527874:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440075264 00000100:00100000:0.0:1762166781.527880:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440075264 00000100:00100000:0.0:1762166781.527912:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 783 00000100:00100000:0.0:1762166781.527918:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:44022:x1847765440075264:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166781.528003:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:44022:x1847765440075264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 85us (176us total) trans 4294968916 rc 0/0 00000100:00100000:0.0:1762166781.528010:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 783 00000100:00100000:3.0:1762166781.533296:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.533364:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440075392 00000100:00100000:0.0:1762166781.533378:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440075392 00000100:00100000:0.0:1762166781.533436:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2710 00000100:00100000:0.0:1762166781.533443:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:44023:x1847765440075392:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:0.0:1762166781.533462:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.533504:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bef6 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bf6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.533584:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.533617:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533628:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533639:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.533647:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533654:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533741:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf0b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.533750:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533757:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166781.533795:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x6:0x0]: returning size 0 00000004:00200000:0.0:1762166781.533799:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166781.533815:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533825:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533834:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533850:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533857:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533863:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533869:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.533873:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533881:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533892:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.533895:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.533900:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533905:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0befd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533917:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533923:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533928:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533933:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.533942:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533948:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533954:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.533955:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.533958:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533961:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf04 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.533980:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bef6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bf6 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.533988:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bf6 expref: 26 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.533995:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.533997:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.533999:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88e00, rc 0) 00000100:00100000:0.0:1762166781.534071:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:44023:x1847765440075392:12345-192.168.204.38@tcp:101:rm.0 Request processed in 627us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.534079:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2710 00000100:00100000:3.0:1762166781.535748:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166781.535789:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.535826:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440075520 00000100:00100000:2.0:1762166781.535836:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440075520 00000100:00100000:1.0:1762166781.535849:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440075648 00000100:00100000:1.0:1762166781.535857:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440075648 00000100:00100000:2.0:1762166781.535902:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 979 00000100:00100000:2.0:1762166781.535925:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440075520:12345-192.168.204.38@tcp:101:rm.0 00000100:00100000:1.0:1762166781.535925:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 980 00000100:00100000:1.0:1762166781.535947:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440075648:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166781.535956:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166781.535964:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166781.535988:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7bfd expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166781.535989:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c04 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166781.536135:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1762166781.536146:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166781.536151:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.536156:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.536164:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 10 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166781.536169:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166781.536175:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166781.536187:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 9 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166781.536207:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 9 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166781.536227:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 10 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166781.536249:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac200, rc 0) 00010000:00010000:1.0:1762166781.536253:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:2.0:1762166781.536322:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440075520:12345-192.168.204.38@tcp:101:rm.0 Request processed in 407us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.536329:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440075648:12345-192.168.204.38@tcp:101:rm.0 Request processed in 384us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166781.536342:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 979 00000100:00100000:1.0:1762166781.536360:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 980 00000100:00100000:1.0:1762166781.538020:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.538070:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440075904 00000100:00100000:0.0:1762166781.538077:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440075904 00000100:00100000:0.0:1762166781.538123:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2711 00000100:00100000:0.0:1762166781.538133:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:44023:x1847765440075904:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:0.0:1762166781.538190:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166781.538211:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf0b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bf6 expref: 26 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.538227:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403ab00) 00010000:00010000:0.0:1762166781.538241:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0bea2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bda expref: 25 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.538249:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.538255:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166781.538274:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.538286:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538295:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538306:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.538314:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538319:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538380:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.538388:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538402:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:0.0:1762166781.538669:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9096 00000040:00080000:0.0:1762166781.538701:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9296 00000004:00080000:0.0:1762166781.538710:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 400687232042ns, next at 401687228665ns, rc = 0 00010000:00010000:0.0:1762166781.538758:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.538767:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538774:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538781:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538788:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538794:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538827:0:6495:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166781.538846:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538853:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538859:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.538869:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166781.538878:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538880:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.538887:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.538890:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166781.538899:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538900:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.538915:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538919:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403ad00) 00010000:00010000:0.0:1762166781.538924:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762166781.538928:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.538934:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf2e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.538935:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff945bc403ad00) 00010000:00010000:2.0:1762166781.538942:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166781.538946:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.538953:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89400/0x2f180c4effb0bf35 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.538967:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166781.538969:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166781.538972:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166781.539046:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539053:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539058:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539063:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539068:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.539070:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539075:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539091:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.539093:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.539096:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539101:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0bf20 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00010000:0.0:1762166781.539111:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c7ebf88b reply state 00000000c4451572 transno 4294967448 ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539119:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.539124:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.539126:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166781.539128:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166781.539176:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:44023:x1847765440075904:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1045us (1159us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1762166781.539183:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2711 00000100:00100000:0.0:1762166781.546960:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166781.547136:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440076160 00000100:00100000:3.0:1762166781.547150:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440076160 00000100:00100000:3.0:1762166781.547211:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2712 00000100:00100000:3.0:1762166781.547224:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:44024:x1847765440076160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166781.547250:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.547272:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bf3c lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c0b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.547431:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547447:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547459:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547471:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547541:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547551:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547702:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bf51 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547711:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bf51 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547739:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bf51 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166781.547751:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x6:0x0]: returning size 0 00010000:00010000:3.0:1762166781.547836:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547852:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547858:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547865:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547872:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166781.547878:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547886:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547906:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166781.547910:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166781.547916:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547922:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0bf43 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547947:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547964:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547970:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547976:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166781.547980:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.547986:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.548000:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:3.0:1762166781.548003:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166781.548007:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.548014:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0bf4a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.548074:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0bf3c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c0b expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.548088:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bf51 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c0b expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.548095:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x6:0x0].0x0 (ffff945bc580a100) 00010000:00010000:3.0:1762166781.548097:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166781.548100:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7800, rc 0) 00000100:00100000:3.0:1762166781.548161:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:44024:x1847765440076160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 940us (1212us total) trans 4294968917 rc 0/0 00000100:00100000:3.0:1762166781.548174:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2712 00000100:00100000:3.0:1762166781.550649:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166781.550729:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440076288 00000100:00100000:1.0:1762166781.550742:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440076288 00000100:00100000:1.0:1762166781.550809:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 981 00000100:00100000:1.0:1762166781.550818:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440076288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166781.550836:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166781.550857:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0bf5f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c12 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166781.550881:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166781.550899:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.550901:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166781.550911:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0bf5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c12 expref: 11 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166781.550927:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0bf5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c12 expref: 11 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166781.550939:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:1.0:1762166781.551009:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440076288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 192us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166781.551269:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 981 00000100:00100000:1.0:1762166781.552218:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.552275:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440076544 00000100:00100000:2.0:1762166781.552281:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440076544 00000100:00100000:2.0:1762166781.552337:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 784 00000100:00100000:2.0:1762166781.552345:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:44024:x1847765440076544:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166781.552575:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:44024:x1847765440076544:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 230us (357us total) trans 4294968918 rc 0/0 00000100:00100000:2.0:1762166781.552583:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 784 00000100:00100000:0.0:1762166781.553890:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166781.553957:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440076672 00000100:00100000:3.0:1762166781.553971:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440076672 00000100:00100000:3.0:1762166781.554038:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2713 00000100:00100000:3.0:1762166781.554049:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:44024:x1847765440076672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166781.554075:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166781.554103:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0bf66 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c19 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.554197:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.554214:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554227:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554239:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166781.554248:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554255:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554308:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554316:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554335:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554343:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554349:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166781.554354:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554363:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554377:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc580a000) 00010000:00010000:3.0:1762166781.554380:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166781.554386:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554393:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0bf6d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554410:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554417:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554422:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554432:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166781.554435:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554464:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554472:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:3.0:1762166781.554510:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166781.554514:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554521:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0bf74 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166781.554567:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0bf66 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c19 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.554580:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc580a000) 00010000:00010000:3.0:1762166781.554583:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166781.554587:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c6000/0x2f180c4effb0bf66 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c19 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166781.554604:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6000, rc 0) 00000100:00100000:3.0:1762166781.554674:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:44024:x1847765440076672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 627us (785us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166781.554681:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2713 00000100:00100000:3.0:1762166781.556368:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.556448:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440076928 00000100:00100000:0.0:1762166781.556457:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440076928 00000100:00100000:0.0:1762166781.556564:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2714 00000100:00100000:0.0:1762166781.556576:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:44024:x1847765440076928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.556598:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.556623:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf7b lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c20 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.556775:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.556789:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.556799:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.556810:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.556824:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.556831:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557222:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.557230:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557237:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166781.557246:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x7:0x0]: returning size 0 00010000:00010000:0.0:1762166781.557275:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557282:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557299:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557304:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557310:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.557314:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557321:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557333:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166781.557336:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.557340:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557345:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bf82 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00010000:0.0:1762166781.557358:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000025129aca reply state 0000000083b5eb08 transno 4294967449 ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557368:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.557373:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166781.557376:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166781.557378:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166781.557405:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bf7b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 29 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.557431:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 28 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.557438:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.557440:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166781.557442:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88600, rc 0) 00000100:00100000:0.0:1762166781.557558:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:44024:x1847765440076928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 983us (1195us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1762166781.557568:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2714 00000100:00100000:1.0:1762166781.560034:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.560142:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440077184 00000100:00100000:0.0:1762166781.560160:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440077184 00000100:00100000:0.0:1762166781.560223:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2715 00000100:00100000:0.0:1762166781.560232:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:44024:x1847765440077184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.560254:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.560269:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0bf9e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c27 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.560384:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.560399:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.560407:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.560437:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.560463:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 30 pid: 6495 timeout: 500 lvb_type: 0 00000100:00100000:0.0:1762166781.560473:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446808832:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166781.560607:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166781.561864:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765446808832:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166781.561884:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166781.562982:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.563091:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440077312 00000100:00100000:2.0:1762166781.563099:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440077312 00010000:00010000:2.0:1762166781.563134:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 31 pid: 6495 timeout: 500 lvb_type: 0 00000100:00100000:2.0:1762166781.563175:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 636 00000100:00100000:2.0:1762166781.563184:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440077312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166781.563204:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166781.563210:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 31 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.563224:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 31 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.563247:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0bf90 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c20 expref: 31 pid: 6495 timeout: 500 lvb_type: 0 00010000:00010000:2.0:1762166781.563266:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff945bc403a200) 00010000:00010000:2.0:1762166781.563271:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.563286:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.563293:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166781.563339:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166781.563398:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440077312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 215us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166781.563406:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 636 00010000:00010000:0.0:1762166781.563541:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.563552:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166781.563575:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x7:0x0]: returning size 0 00000004:00080000:0.0:1762166781.563736:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1e:0x0], index 0: 0 00000004:00080000:0.0:1762166781.563743:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1c:0x0], index 1: 0 00010000:00010000:0.0:1762166781.563862:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.563871:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.563878:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.563883:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.563887:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.563902:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.563911:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.563914:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166781.563918:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.563924:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89600/0x2f180c4effb0bfa5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166781.563967:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0bf9e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c27 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.563977:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff945bc403a200) 00010000:00010000:0.0:1762166781.563980:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166781.563984:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0bf9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c27 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.563999:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89000, rc 0) 00000100:00100000:0.0:1762166781.564041:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:44024:x1847765440077184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3810us (4021us total) trans 4294967450 rc 301/301 00000100:00100000:0.0:1762166781.564049:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2715 00000100:00100000:1.0:1762166781.566899:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.566974:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440077568 00000100:00100000:2.0:1762166781.566989:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440077568 00000100:00100000:2.0:1762166781.567065:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 785 00000100:00100000:2.0:1762166781.567078:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:44024:x1847765440077568:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166781.567511:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:44024:x1847765440077568:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 403us (592us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1762166781.567521:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 785 00000100:00100000:3.0:1762166781.568882:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166781.568933:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440077824 00000100:00100000:2.0:1762166781.568941:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440077824 00000100:00100000:2.0:1762166781.568993:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 786 00000100:00100000:2.0:1762166781.569004:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:44024:x1847765440077824:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166781.569223:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:44024:x1847765440077824:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 220us (345us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1762166781.569231:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 786 00000100:00100000:1.0:1762166781.580769:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.580865:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440078080 00000100:00100000:0.0:1762166781.580891:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440078080 00000100:00100000:0.0:1762166781.580992:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2716 00000100:00100000:0.0:1762166781.581008:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+48:44027:x1847765440078080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166781.581052:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166781.581097:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0bfb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c2e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.581320:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89600/0x2f180c4effb0bfba lrc: 3/1,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.581341:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89600/0x2f180c4effb0bfba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.581356:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89600/0x2f180c4effb0bfba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.581371:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1762166781.581581:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0bfb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c2e expref: 51 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.581603:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89600/0x2f180c4effb0bfba lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c2e expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166781.581614:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166781.581617:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166781.581621:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89600, rc 0) 00000100:00100000:0.0:1762166781.581704:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:44027:x1847765440078080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 700us (951us total) trans 4294968919 rc 0/0 00000100:00100000:0.0:1762166781.581710:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2716 00000100:00100000:1.0:1762166781.583310:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166781.583391:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440078208 00000100:00100000:0.0:1762166781.583403:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440078208 00000100:00100000:0.0:1762166781.583521:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2717 00000100:00100000:0.0:1762166781.583545:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:44027:x1847765440078208:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166781.583642:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583678:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583690:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583704:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583713:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583720:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583812:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583821:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583828:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166781.583869:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x6:0x0]: returning size 0 00000004:00200000:0.0:1762166781.583873:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166781.583885:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583897:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583902:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583914:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583919:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583923:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.583926:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583931:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583940:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166781.583942:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.583946:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583950:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0bfc8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583960:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583963:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583966:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583970:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.583972:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583984:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.583991:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:0.0:1762166781.583994:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.583996:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.584002:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0bfcf lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.584014:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.584020:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.584025:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.584030:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166781.584033:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.584038:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.584045:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x6:0x0].0x0 (ffff945bc580a100) 00010000:00010000:0.0:1762166781.584047:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166781.584050:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166781.584055:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfd6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166781.584135:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:44027:x1847765440078208:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 604us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166781.584144:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2717 00010000:00010000:1.0:1762166781.714708:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1762166782.738705:0:9164:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401887224392ns, next at 402887219919ns, rc = 0 00000100:00100000:2.0:1762166782.738711:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446808960:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1762166782.738751:0:9159:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 401887271102ns, next at 402887267349ns, rc = 0 00000100:00100000:2.0:1762166782.738790:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166782.738798:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1762166782.738817:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166782.738821:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446809088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166782.738850:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446808960 00000100:00100000:3.0:1762166782.738855:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166782.738860:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446808960 00000100:00080000:2.0:1762166782.738901:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166782.738928:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446809088 00000100:00100000:1.0:1762166782.738933:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446809088 00000100:00100000:3.0:1762166782.738953:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1762166782.738986:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1762166782.739000:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765446809088:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1762166782.739004:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166782.739027:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446808960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1762166782.739046:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 17096384 pending 0 free 3922427904 avail 3690905600 00002000:00000024:1.0:1762166782.739046:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 17096384 pending 0 free 3922427904 avail 3690905600 00000100:00100000:1.0:1762166782.739114:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765446809088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.739118:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446808960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.739130:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1762166782.739137:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1762166782.739161:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446808960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166782.739184:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446809088:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1762166782.740294:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 105 committed 00000001:00080000:0.0:1762166782.740330:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968919 is committed 00000004:00080000:0.0:1762166782.740356:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00000004:00080000:0.0:1762166782.740397:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 104 committed 00010000:00010000:2.0:1762166782.740401:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.740431:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00000020:00080000:0.0:1762166782.740432:0:6475:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cf1eaf6c0 refcount 2 committed 0 result 0 batchid 43 00000020:00080000:0.0:1762166782.740442:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf7812600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1eaf9c0 00010000:00010000:2.0:1762166782.740447:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00000020:00080000:0.0:1762166782.740449:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].8 00000020:00080000:0.0:1762166782.740456:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf7812d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc7070e00 00000020:00080000:0.0:1762166782.740459:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].20 00010000:00010000:2.0:1762166782.740473:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1a00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166782.740535:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446809344:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166782.740536:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.740560:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000020:00080000:0.0:1762166782.740563:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 43 committed batchid 42 00000100:00100000:1.0:1762166782.740582:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1762166782.740585:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x237edbbc (ffff945cd0738100) 00000100:00100000:3.0:1762166782.740593:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166782.740599:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166782.740610:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166782.740610:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446809216:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166782.740625:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0bb3e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x237edbbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:0.0:1762166782.740637:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 42 00000100:00100000:3.0:1762166782.740648:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1762166782.740663:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166782.740667:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446809472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166782.740686:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446809344 00010000:00010000:2.0:1762166782.740688:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166782.740689:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166782.740694:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446809344 00010000:00010000:2.0:1762166782.740701:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.740708:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166782.740712:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.740741:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166782.740742:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166782.740760:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166782.740764:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166782.740768:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166782.740768:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446809216 00000100:00100000:0.0:1762166782.740775:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446809216 00010000:00010000:2.0:1762166782.740779:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0bb45 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166782.740790:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446809472 00000100:00100000:1.0:1762166782.740798:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446809472 00010000:00010000:2.0:1762166782.740800:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.740809:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.740817:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.740823:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad400 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166782.740828:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00010000:00010000:2.0:1762166782.740829:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.740839:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166782.740844:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765446809344:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166782.740847:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1762166782.740865:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00010000:00010000:2.0:1762166782.740866:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945bc477f100) 00000100:00100000:3.0:1762166782.740874:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3635:x1847765446809216:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166782.740877:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:0.0:1762166782.740883:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:73 count 1 00010000:00010000:2.0:1762166782.740886:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166782.740886:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446809472:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762166782.740900:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0bb4c lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00002000:00080000:3.0:1762166782.740905:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:72 count 1 00002000:00080000:1.0:1762166782.740915:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:67 count 1 00010000:00010000:0.0:1762166782.740915:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.740938:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.740942:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 10 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166782.740945:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166782.740946:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.740971:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 8 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166782.740994:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741020:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166782.741027:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 10 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166782.741050:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166782.741055:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166782.741058:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166782.741067:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166782.741068:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.741073:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.741080:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.741095:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166782.741097:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166782.741098:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.741107:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.741115:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166782.741130:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:2.0:1762166782.741136:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166782.741141:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166782.741141:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 10 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166782.741147:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 8 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166782.741164:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 10 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166782.741166:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7000/0x2f180c4effb0bbca lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166782.741178:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 8 pid: 28874 timeout: 501 lvb_type: 1 00010000:00010000:0.0:1762166782.741178:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 10 pid: 8382 timeout: 501 lvb_type: 1 00010000:00010000:2.0:1762166782.741187:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741235:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166782.741245:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 10 pid: 28874 timeout: 501 lvb_type: 1 00000100:00100000:1.0:1762166782.741249:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446809728:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166782.741249:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446809600:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166782.741251:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166782.741302:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446809856:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166782.741305:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166782.741311:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741318:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741330:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:2.0:1762166782.741333:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166782.741337:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741343:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb4000/0x2f180c4effb0bccd lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166782.741352:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166782.741356:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166782.741357:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe600 going to sleep for 11 seconds 00010000:00010000:2.0:1762166782.741361:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741370:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741377:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741385:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166782.741389:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741396:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741406:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:2.0:1762166782.741415:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166782.741420:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00080000:3.0:1762166782.741426:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1762166782.741427:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5800/0x2f180c4effb0bcf0 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741452:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741460:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741466:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741471:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166782.741475:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741536:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741545:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:2.0:1762166782.741548:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166782.741551:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741558:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0be40 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741573:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741580:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741593:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741598:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166782.741601:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741607:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741615:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xeb4e88c0 (ffff945bc580aa00) 00010000:00010000:2.0:1762166782.741617:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166782.741620:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166782.741625:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5a00/0x2f180c4effb0becc lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x8:0x0].0xeb4e88c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166782.743247:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166782.743262:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446809600:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166782.743265:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446809728:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166782.743266:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446809856:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166782.743284:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166782.743316:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166782.743322:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.743328:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.743337:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166782.743371:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440078336 00000100:00100000:3.0:1762166782.743378:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440078336 00000100:00100000:2.0:1762166782.743389:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440078592 00000100:00100000:2.0:1762166782.743393:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440078592 00010000:00010000:3.0:1762166782.743408:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 11 pid: 8382 timeout: 501 lvb_type: 1 00000100:00100000:1.0:1762166782.743413:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440078464 00010000:00010000:2.0:1762166782.743414:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 9 pid: 28874 timeout: 501 lvb_type: 1 00000100:00100000:1.0:1762166782.743421:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440078464 00010000:00010000:1.0:1762166782.743444:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 12 pid: 28874 timeout: 501 lvb_type: 1 00000100:00100000:3.0:1762166782.743458:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 637 00000100:00100000:2.0:1762166782.743470:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 638 00000100:00100000:3.0:1762166782.743473:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440078336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166782.743541:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 639 00000100:00100000:2.0:1762166782.743542:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440078592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166782.743543:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166782.743553:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 12 pid: 8382 timeout: 501 lvb_type: 1 00000100:00100000:1.0:1762166782.743560:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440078464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166782.743561:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166782.743570:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 9 pid: 28874 timeout: 501 lvb_type: 1 00010000:00010000:1.0:1762166782.743576:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166782.743579:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 12 pid: 8382 timeout: 501 lvb_type: 1 00010000:00010000:2.0:1762166782.743582:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 9 pid: 28874 timeout: 501 lvb_type: 1 00010000:00010000:1.0:1762166782.743594:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 12 pid: 28874 timeout: 501 lvb_type: 1 00010000:00010000:1.0:1762166782.743617:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 12 pid: 28874 timeout: 501 lvb_type: 1 00010000:00010000:2.0:1762166782.743620:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0bd83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b86 expref: 9 pid: 28874 timeout: 501 lvb_type: 1 00010000:00010000:3.0:1762166782.743622:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0bd8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b8d expref: 12 pid: 8382 timeout: 501 lvb_type: 1 00010000:00010000:2.0:1762166782.743647:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166782.743651:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.743652:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0bc2c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b32 expref: 12 pid: 28874 timeout: 501 lvb_type: 1 00010000:00010000:2.0:1762166782.743656:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.743675:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166782.743677:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.743679:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.743681:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166782.743685:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.743686:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166782.743691:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.743700:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.743705:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166782.743706:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166782.743737:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166782.743738:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166782.743759:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166782.743760:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+8:2417:x1847765440078592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 217us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166782.743780:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440078336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 304us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166782.743785:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440078464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 225us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166782.743805:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 638 00010000:00010000:0.0:1762166782.743810:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166782.743817:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 637 00000100:00100000:1.0:1762166782.743834:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 639 00010000:00010000:0.0:1762166782.743835:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166782.743836:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.743851:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166782.743890:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.743893:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.743944:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.743949:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166782.743971:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166782.743999:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166782.744003:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.744014:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166782.744024:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1762166782.744031:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1762166782.744061:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1762166782.744072:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744084:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166782.744089:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744116:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744141:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744149:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0bfe4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744189:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762166782.744194:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744202:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166782.744205:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744214:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744231:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744241:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bccb88400/0x2f180c4effb0bfdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744288:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166782.744293:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744301:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166782.744305:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744315:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744331:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744348:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0bfeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166782.744371:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166782.744374:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166782.744381:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166782.744427:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446809472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3544us (3698us total) trans 17179869358 rc 0/0 00010000:00010000:1.0:1762166782.744428:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166782.744437:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765446809344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3589us (3838us total) trans 21474836675 rc 0/0 00010000:00010000:1.0:1762166782.744439:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166782.744444:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3635:x1847765446809216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3572us (3755us total) trans 21474836674 rc 0/0 00000100:00100000:0.0:1762166782.744462:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:2.0:1762166782.744520:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1762166782.744548:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000004:00080000:0.0:1762166782.744604:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406fb80/2, rc 0, transno 21474836674 00000100:00100000:0.0:1762166782.744615:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446809216:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1762166782.744644:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc95b1f80/2, rc 0, transno 17179869358 00000100:00100000:3.0:1762166782.744652:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446809472:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1762166782.744664:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406ea00/2, rc 0, transno 21474836675 00000100:00100000:3.0:1762166782.744669:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446809344:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1762166782.745966:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869358 is committed 00000001:00080000:3.0:1762166782.745978:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869357 is committed 00000001:00080000:1.0:1762166782.745983:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836675 is committed 00000001:00080000:1.0:1762166782.746001:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836673 is committed 00000100:00100000:1.0:1762166782.949551:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166782.949634:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440078848 00000100:00100000:0.0:1762166782.949649:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440078848 00000100:00080000:3.0:1762166782.949727:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166782.949755:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2718 00000100:00100000:0.0:1762166782.949766:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:44407:x1847765440078848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166782.949793:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166782.949818:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bff2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c35 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.949913:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166782.949927:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.949942:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.949958:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166782.949989:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.949995:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950090:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950096:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950101:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950105:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950110:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166782.950114:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950122:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950135:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc4077400) 00010000:00010000:0.0:1762166782.950138:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166782.950143:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950147:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89c00/0x2f180c4effb0bff9 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950161:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950173:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950179:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950184:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166782.950187:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950193:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950202:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166782.950205:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166782.950208:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950214:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89000/0x2f180c4effb0c000 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.950247:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bff2 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c35 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.950257:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc4077400) 00010000:00010000:0.0:1762166782.950259:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166782.950262:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0bff2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c35 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166782.950274:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88e00, rc 0) 00000100:00100000:0.0:1762166782.950335:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:44407:x1847765440078848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 572us (801us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166782.950347:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2718 00000100:00100000:1.0:1762166782.951529:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166782.951597:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440078976 00000100:00100000:0.0:1762166782.951608:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440078976 00000100:00100000:0.0:1762166782.951654:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2719 00000100:00100000:0.0:1762166782.951664:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:44407:x1847765440078976:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166782.951727:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166782.951741:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951751:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951762:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166782.951770:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951776:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951832:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166782.951840:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951846:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166782.951890:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x7:0x0]: returning size 0 00000004:00200000:0.0:1762166782.951901:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166782.951913:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951924:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951928:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951932:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951937:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951942:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166782.951945:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951951:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951961:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc4077100) 00010000:00010000:0.0:1762166782.951964:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166782.951968:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951974:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88c00/0x2f180c4effb0c007 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951989:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.951996:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952007:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952013:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166782.952016:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952021:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952027:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:0.0:1762166782.952029:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166782.952030:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952034:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88400/0x2f180c4effb0c00e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952041:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952044:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952047:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952050:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166782.952052:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952055:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952065:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:0.0:1762166782.952066:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166782.952068:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166782.952071:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88600/0x2f180c4effb0c015 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166782.952127:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:44407:x1847765440078976:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 465us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166782.952132:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2719 00010000:00010000:1.0:1762166783.762741:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166783.762769:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446809984:0@lo:400:kworker.0 00000100:00100000:1.0:1762166783.762797:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446810240:0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.762809:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446810112:0@lo:400:kworker.0 00000100:00100000:0.0:1762166783.762862:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166783.762877:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166783.762934:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166783.762952:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446810496:0@lo:400:kworker.0 00000100:00100000:1.0:1762166783.762953:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446810752:0@lo:400:kworker.0 00000100:00100000:0.0:1762166783.763013:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166783.763019:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446810624:0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.763020:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446809984 00000100:00100000:1.0:1762166783.763021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166783.763035:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446809984 00000100:00100000:0.0:1762166783.763051:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446811008:0@lo:400:kworker.0 00000100:00100000:1.0:1762166783.763071:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446811264:0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.763087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166783.763110:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1762166783.763122:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446810112 00000100:00100000:3.0:1762166783.763130:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446809984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166783.763132:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446810112 00000100:00100000:1.0:1762166783.763134:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166783.763144:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446811136:0@lo:400:kworker.0 00000100:00100000:0.0:1762166783.763154:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166783.763168:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1762166783.763180:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446810368:0@lo:400:kworker.0 00000100:00100000:0.0:1762166783.763189:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446811520:0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.763205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166783.763215:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446809984:12345-0@lo:400:kworker.0 Request processed in 88us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166783.763228:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1762166783.763245:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166783.763265:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446811264 00000100:00100000:0.0:1762166783.763271:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446811264 00000100:00100000:2.0:1762166783.763287:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446811136 00000100:00100000:3.0:1762166783.763293:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446810240 00000100:00100000:2.0:1762166783.763296:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446811136 00000100:00100000:1.0:1762166783.763298:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446810880:0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.763300:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446810240 00000100:00100000:0.0:1762166783.763322:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446810368 00000100:00100000:0.0:1762166783.763326:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446810368 00000100:00100000:1.0:1762166783.763353:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166783.763376:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446810496 00000100:00100000:3.0:1762166783.763382:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446810496 00000100:00100000:0.0:1762166783.763383:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1762166783.763389:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1847765446811392:0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.763397:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1762166783.763398:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446811264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.763410:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1762166783.763416:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446811136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.763430:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446810240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166783.763430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166783.763455:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446811264:12345-0@lo:400:kworker.0 Request processed in 60us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166783.763470:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1762166783.763472:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446811264:0@lo:400:kworker.0 00000100:00100000:0.0:1762166783.763536:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446811392 00000100:00100000:0.0:1762166783.763541:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446811392 00000100:00100000:3.0:1762166783.763547:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446810240:12345-0@lo:400:kworker.0 Request processed in 126us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166783.763551:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446810240:0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.763560:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446811136:12345-0@lo:400:kworker.0 Request processed in 144us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166783.763572:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1762166783.763573:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1762166783.763587:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1762166783.763592:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446810368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.763602:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1762166783.763603:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1762166783.763617:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446810496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166783.763620:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1847765446811392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.763638:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446810752 00000100:00100000:2.0:1762166783.763647:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446810752 00000100:00100000:0.0:1762166783.763648:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446810368:12345-0@lo:400:kworker.0 Request processed in 61us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166783.763656:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1762166783.763665:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1847765446811392:12345-0@lo:400:kworker.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166783.763676:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446810496:12345-0@lo:400:kworker.0 Request processed in 64us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166783.763677:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1762166783.763693:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1762166783.763709:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446810624 00000100:00100000:0.0:1762166783.763715:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446810624 00000100:00100000:2.0:1762166783.763725:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446811008 00000100:00100000:2.0:1762166783.763732:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446811008 00000100:00080000:3.0:1762166783.763742:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1762166783.763752:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166783.763766:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446810880 00000100:00100000:0.0:1762166783.763772:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446810880 00000100:00100000:1.0:1762166783.763786:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1762166783.763801:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1762166783.763802:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446810752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.763812:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1762166783.763821:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446810624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.763830:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446811008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166783.763839:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1762166783.763846:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446810752:12345-0@lo:400:kworker.0 Request processed in 48us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166783.763856:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446810880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166783.763872:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1762166783.763906:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446811008:12345-0@lo:400:kworker.0 Request processed in 82us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166783.763916:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1762166783.763927:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446810624:12345-0@lo:400:kworker.0 Request processed in 113us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166783.763938:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446810880:12345-0@lo:400:kworker.0 Request processed in 84us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166783.763942:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1762166783.763955:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1762166783.763961:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1762166783.763976:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446810112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.763994:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836673 gen 2 00000004:00080000:3.0:1762166783.763999:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58ce680, transno 21474836671 00000100:00100000:1.0:1762166783.764012:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446810112:12345-0@lo:400:kworker.0 Request processed in 48us (1081us total) trans 0 rc 0/0 00000100:00080000:0.0:1762166783.764012:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1762166783.764015:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58cfb80, transno 21474836672 00000004:00080000:3.0:1762166783.764023:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58cd880, transno 21474836673 00000100:00100000:1.0:1762166783.764025:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1762166783.764031:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446810624:0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.764040:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166783.764057:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446811136:0@lo:400:kworker.0 00000100:00100000:1.0:1762166783.764057:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446811520 00000100:00100000:1.0:1762166783.764065:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446811520 00000100:00100000:3.0:1762166783.764081:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446810112:0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.764114:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446809984:0@lo:400:kworker.0 00000100:00100000:1.0:1762166783.764127:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1762166783.764141:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446811520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166783.764143:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446810368:0@lo:400:kworker.0 00000004:00080000:0.0:1762166783.764148:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1762166783.764174:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869357 gen 2 00000100:00100000:2.0:1762166783.764180:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446810496:0@lo:400:kworker.0 00000004:00080000:3.0:1762166783.764181:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd2680, transno 17179869356 00000100:00080000:0.0:1762166783.764184:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166783.764197:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446811520:12345-0@lo:400:kworker.0 Request processed in 55us (156us total) trans 0 rc 0/0 00000004:00080000:3.0:1762166783.764204:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd3b80, transno 17179869357 00000100:00100000:1.0:1762166783.764210:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1762166783.764215:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446810880:0@lo:400:kworker.0 00000100:00100000:2.0:1762166783.764217:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869358 gen 2 00000004:00080000:2.0:1762166783.764225:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd0a80, transno 17179869354 00000100:00100000:3.0:1762166783.764242:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1847765446811392:0@lo:400:kworker.0 00000004:00080000:2.0:1762166783.764245:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4010e00, transno 17179869355 00000004:00080000:2.0:1762166783.764255:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc95b1f80, transno 17179869358 00000100:00100000:3.0:1762166783.764262:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836675 gen 2 00000100:00100000:2.0:1762166783.764268:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446811008:0@lo:400:kworker.0 00000004:00080000:3.0:1762166783.764271:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc494dc00, transno 21474836668 00000004:00080000:3.0:1762166783.764291:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc494ea00, transno 21474836669 00000004:00080000:3.0:1762166783.764299:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc494fb80, transno 21474836670 00000100:00100000:2.0:1762166783.764303:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446811520:0@lo:400:kworker.0 00000004:00080000:3.0:1762166783.764306:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406fb80, transno 21474836674 00000004:00080000:3.0:1762166783.764317:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406ea00, transno 21474836675 00000100:00100000:3.0:1762166783.764329:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446810752:0@lo:400:kworker.0 00000004:00080000:0.0:1762166783.764355:0:10004:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000004:00080000:2.0:1762166783.764533:0:9163:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:3.0:1762166784.269025:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166784.269095:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440079104 00000100:00100000:0.0:1762166784.269105:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440079104 00000100:00100000:3.0:1762166784.269110:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166784.269144:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166784.269162:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 602 00000100:00100000:0.0:1762166784.269172:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2416:x1847765440079104:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166784.269179:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440079232 00000100:00100000:3.0:1762166784.269181:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.269187:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440079232 00000100:00100000:2.0:1762166784.269214:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440079488 00000100:00100000:2.0:1762166784.269221:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440079488 00000100:00100000:0.0:1762166784.269235:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2416:x1847765440079104:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 64us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.269236:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.269239:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440079360 00000100:00100000:1.0:1762166784.269244:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440079360 00000100:00100000:0.0:1762166784.269257:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 602 00000100:00100000:2.0:1762166784.269266:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440079616 00000100:00100000:2.0:1762166784.269272:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440079616 00000100:00100000:1.0:1762166784.269282:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 406 00000100:00100000:1.0:1762166784.269294:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765440079232:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166784.269296:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 247 00000100:00100000:0.0:1762166784.269308:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440079488:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166784.269314:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 248 00000100:00100000:2.0:1762166784.269327:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+8:2416:x1847765440079616:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166784.269346:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765440079232:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 55us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.269350:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440079488:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.269360:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 406 00000100:00100000:0.0:1762166784.269365:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 247 00000100:00100000:2.0:1762166784.269368:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+8:2416:x1847765440079616:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 42us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.269379:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 248 00000100:00100000:1.0:1762166784.269384:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 407 00000100:00100000:1.0:1762166784.269399:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765440079360:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:3.0:1762166784.269402:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1762166784.269409:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1762166784.269412:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1762166784.269414:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166784.269434:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765440079360:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 38us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.269449:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 407 00000100:00100000:3.0:1762166784.321612:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.321690:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440079744 00000100:00100000:1.0:1762166784.321702:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440079744 00000100:00100000:1.0:1762166784.321772:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2720 00000100:00100000:1.0:1762166784.321784:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44789:x1847765440079744:12345-192.168.204.38@tcp:41:stat.0 00000004:00000024:1.0:1762166784.321837:0:30829:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7845916672 avail 7382872064 00000100:00100000:1.0:1762166784.321910:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44789:x1847765440079744:12345-192.168.204.38@tcp:41:stat.0 Request processed in 128us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.321918:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2720 00000100:00100000:0.0:1762166784.337722:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.337804:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440079872 00000100:00100000:1.0:1762166784.337816:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440079872 00000100:00100000:1.0:1762166784.337873:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2721 00000100:00100000:1.0:1762166784.337884:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:44793:x1847765440079872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.337905:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.337928:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0c01c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c3c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.337987:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.338006:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338019:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338056:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.338082:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338088:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338129:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338136:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338142:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338147:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.338151:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338157:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338169:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166784.338172:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.338175:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338181:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c023 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338193:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338198:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338209:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338214:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.338217:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338222:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338228:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff945cd0738900) 00010000:00010000:1.0:1762166784.338230:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.338233:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338238:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c02a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.338267:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0c01c lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c3c expref: 32 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.338276:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd0738000) 00010000:00010000:1.0:1762166784.338279:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.338283:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0c01c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c3c expref: 32 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.338292:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0800, rc 0) 00000100:00100000:1.0:1762166784.338358:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:44793:x1847765440079872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 473us (643us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166784.338366:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2721 00000100:00100000:3.0:1762166784.339545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.339576:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440080000 00000100:00100000:1.0:1762166784.339581:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440080000 00000100:00100000:1.0:1762166784.339611:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2722 00000100:00100000:1.0:1762166784.339621:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:44793:x1847765440080000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.339630:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.339640:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c031 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c43 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.339672:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.339681:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339689:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339698:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.339704:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339710:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339727:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339733:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339738:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339750:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.339753:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339758:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339766:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd0738400) 00010000:00010000:1.0:1762166784.339769:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.339772:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339778:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c038 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339787:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339792:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339797:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339801:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.339804:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339809:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339815:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff945cd0738500) 00010000:00010000:1.0:1762166784.339817:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.339825:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339830:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c03f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.339853:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c031 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c43 expref: 32 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.339862:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd0738400) 00010000:00010000:1.0:1762166784.339864:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.339868:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c031 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c43 expref: 32 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.339877:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:1.0:1762166784.339910:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:44793:x1847765440080000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 292us (365us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166784.339916:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2722 00000100:00100000:3.0:1762166784.341073:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.341109:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440080128 00000100:00100000:1.0:1762166784.341115:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440080128 00000100:00100000:1.0:1762166784.341154:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2723 00000100:00100000:1.0:1762166784.341162:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44793:x1847765440080128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.341171:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.341183:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0c046 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c4a expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.341216:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0c04d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.341224:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0c04d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.341242:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0c04d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000004:00200000:1.0:1762166784.341278:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1762166784.341282:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1762166784.341307:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1a00/0x2f180c4effb0c046 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c4a expref: 16 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.341329:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0c04d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c4a expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.341339:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffff945cd0738e00) 00010000:00010000:1.0:1762166784.341342:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166784.341344:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:1.0:1762166784.341379:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:44793:x1847765440080128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 218us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.341385:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2723 00000100:00100000:0.0:1762166784.342191:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.342226:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440080256 00000100:00100000:1.0:1762166784.342231:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440080256 00000100:00100000:1.0:1762166784.342261:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2724 00000100:00100000:1.0:1762166784.342268:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:44793:x1847765440080256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.342277:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.342287:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c054 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c51 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.342312:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.342320:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.342333:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:1.0:1762166784.342356:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1762166784.342359:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1762166784.342378:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c054 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 33 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.342390:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 32 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.342396:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166784.342399:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166784.342401:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:1.0:1762166784.342430:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:44793:x1847765440080256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 163us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.342438:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2724 00000100:00100000:3.0:1762166784.344665:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.344701:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440080512 00000100:00100000:1.0:1762166784.344707:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440080512 00000100:00100000:1.0:1762166784.344743:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2725 00000100:00100000:1.0:1762166784.344753:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:44793:x1847765440080512:12345-192.168.204.38@tcp:36:lfs.0 00000100:00100000:1.0:1762166784.344851:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446811648:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.344894:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166784.344944:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446811648 00000100:00100000:3.0:1762166784.344949:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446811648 00000100:00100000:1.0:1762166784.344958:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166784.344995:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1762166784.345001:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446811648:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1762166784.345064:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446811648:12345-0@lo:1000:mdt00_005.0 Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.345072:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1762166784.345096:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446811648:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.345141:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446811776:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.345175:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.345196:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166784.345224:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446811776 00000100:00100000:3.0:1762166784.345229:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446811776 00000100:00100000:3.0:1762166784.345263:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1762166784.345269:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446811776:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1762166784.345329:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446811776:12345-0@lo:1000:mdt00_005.0 Request processed in 60us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.345337:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1762166784.345347:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446811776:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.345372:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446811904:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.345387:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.345402:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166784.345407:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446811904 00000100:00100000:3.0:1762166784.345411:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446811904 00000100:00100000:3.0:1762166784.345428:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1762166784.345432:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446811904:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1762166784.345471:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446811904:12345-0@lo:1000:mdt00_005.0 Request processed in 38us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.345508:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1762166784.345534:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446811904:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.345567:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812032:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.345582:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.345602:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166784.345614:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446812032 00000100:00100000:3.0:1762166784.345617:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446812032 00000100:00100000:3.0:1762166784.345635:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1762166784.345639:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446812032:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1762166784.345690:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446812032:12345-0@lo:1000:mdt00_005.0 Request processed in 50us (106us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166784.345695:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1762166784.345706:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812032:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1762166784.345751:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.345761:0:30829:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.345770:0:30829:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 30829 initiator: MDT0 00000100:00100000:1.0:1762166784.345781:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812160:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1762166784.345803:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.345822:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166784.345832:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446812160 00000100:00100000:3.0:1762166784.345836:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446812160 00000100:00100000:3.0:1762166784.345853:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1762166784.345857:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30829:x1847765446812160:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1762166784.345863:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166784.345874:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0c062 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.345898:0:6499:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 31 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.345904:0:6499:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0c062 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.345920:0:6499:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 31 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.345930:0:6499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 31 pid: 30829 timeout: 503 lvb_type: 0 00000100:00100000:3.0:1762166784.345941:0:6499:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6499:1847765446812288:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166784.345994:0:6499:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.347017:0:6499:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6499:1847765446812288:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166784.347033:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c062 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.347043:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd0738600) 00010000:00010000:0.0:1762166784.347045:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166784.347049:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c062 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.347056:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7c00, rc 0) 00000100:00100000:0.0:1762166784.347093:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:30829:x1847765446812160:12345-0@lo:101:mdt00_005.0 Request processed in 1235us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.347100:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1762166784.347126:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812160:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1762166784.347140:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.347161:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166784.347293:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.347337:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440080640 00000100:00100000:1.0:1762166784.347342:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440080640 00010000:00010000:1.0:1762166784.347361:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 32 pid: 30829 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1762166784.347391:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 640 00000100:00100000:1.0:1762166784.347402:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765440080640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166784.347412:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166784.347417:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 32 pid: 30829 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166784.347428:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 32 pid: 30829 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166784.347444:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c05b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c51 expref: 32 pid: 30829 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166784.347456:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166784.347460:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c062 expref: 5 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.347470:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0c062 expref: 5 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.347521:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0c062 expref: 5 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.347543:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c062 expref: 5 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.347553:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:8398:1847765446812416:0@lo:105: 00000100:00100000:1.0:1762166784.347579:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.347608:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.347632:0:8397:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1762166784.347647:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446812416 00000100:00100000:2.0:1762166784.347651:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446812416 00000100:00100000:2.0:1762166784.347681:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1762166784.347686:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4922050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8398:x1847765446812416:12345-0@lo:105: 00010000:00010000:2.0:1762166784.347694:0:8397:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.347701:0:8397:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.347707:0:8397:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.347712:0:8397:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.347716:0:8397:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.347722:0:8397:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.347737:0:8397:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945bc60b0600) 00010000:00010000:1.0:1762166784.347759:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.347769:0:30829:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166784.347780:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4922050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8398:x1847765446812416:12345-0@lo:105: Request processed in 92us (198us total) trans 0 rc 0/0 00000004:00080000:1.0:1762166784.347785:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000100:00100000:2.0:1762166784.347790:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1762166784.347809:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.347817:0:30829:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30829 initiator: MDT0 00000100:00100000:3.0:1762166784.347824:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:8398:1847765446812416:0@lo:105: 00010000:00010000:1.0:1762166784.347825:0:30829:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166784.347840:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166784.347843:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812544:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1762166784.347870:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166784.347880:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440080640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 480us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.347890:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 640 00000100:00100000:1.0:1762166784.347894:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.347919:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446812544 00000100:00100000:2.0:1762166784.347924:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446812544 00000100:00100000:2.0:1762166784.347956:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1762166784.347971:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:30829:x1847765446812544:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1762166784.347981:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.347993:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0c077 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0c070 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.348009:0:6499:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0c077 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0c070 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.348019:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0c077 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c070 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.348026:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff945cf39a3500) 00010000:00010000:2.0:1762166784.348029:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166784.348031:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00000100:00100000:2.0:1762166784.348061:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446812544:12345-0@lo:101:mdt00_005.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.348066:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1762166784.348088:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812544:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1762166784.348107:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.348116:0:30829:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166784.348126:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000100:00100000:1.0:1762166784.348148:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812672:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348171:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.348192:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.348222:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446812672 00000100:00100000:2.0:1762166784.348227:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446812672 00000100:00100000:2.0:1762166784.348252:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1762166784.348258:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446812672:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1762166784.348301:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446812672:12345-0@lo:1000:mdt00_005.0 Request processed in 44us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.348306:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1762166784.348317:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812672:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348349:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812800:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348370:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.348388:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.348407:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446812800 00000100:00100000:2.0:1762166784.348412:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446812800 00000100:00100000:2.0:1762166784.348433:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1762166784.348438:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446812800:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1762166784.348521:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446812800:12345-0@lo:1000:mdt00_005.0 Request processed in 82us (149us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166784.348527:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:1.0:1762166784.348541:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812800:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348598:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812928:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348620:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166784.348640:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446812928 00000100:00100000:1.0:1762166784.348641:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.348644:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446812928 00000100:00100000:2.0:1762166784.348661:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1762166784.348667:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446812928:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1762166784.348704:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446812928:12345-0@lo:1000:mdt00_005.0 Request processed in 38us (84us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166784.348709:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1762166784.348722:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446812928:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348764:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446813056:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348786:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166784.348806:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446813056 00000100:00100000:1.0:1762166784.348806:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.348810:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446813056 00000100:00100000:2.0:1762166784.348828:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1762166784.348832:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446813056:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1762166784.348865:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446813056:12345-0@lo:1000:mdt00_005.0 Request processed in 32us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.348869:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1762166784.348881:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446813056:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348919:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446813184:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.348949:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166784.348968:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446813184 00000100:00100000:1.0:1762166784.348968:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.348975:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446813184 00000100:00100000:2.0:1762166784.348991:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1762166784.348995:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446813184:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1762166784.349026:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446813184:12345-0@lo:1000:mdt00_005.0 Request processed in 31us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.349031:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1762166784.349042:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446813184:0@lo:1000:mdt00_005.0 00000040:00080000:1.0:1762166784.349821:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].21, 2136 off51664 00000040:00080000:1.0:1762166784.349894:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].9, 2336 off49024 00000004:00080000:1.0:1762166784.349904:0:30829:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc10de000 with version 19 00000004:00080000:2.0:1762166784.349939:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 19 rpc_version 19 00000020:00100000:2.0:1762166784.349962:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1762166784.349970:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc5ef5f80 x1847765446813440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166784.349990:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446813440:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166784.350023:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166784.350044:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.350064:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446813440 00000100:00100000:0.0:1762166784.350069:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446813440 00000100:00100000:0.0:1762166784.350092:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1762166784.350096:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8087:x1847765446813440:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166784.350532:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8087:x1847765446813440:12345-0@lo:1000:osp_up1-0.0 Request processed in 434us (506us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1762166784.350538:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1762166784.350574:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446813440:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1762166784.350654:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350661:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350667:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350682:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350686:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350690:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350705:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350708:0:30829:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350713:0:30829:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 30829 initiator: MDT0 00000100:00100000:0.0:1762166784.350722:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446813568:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1762166784.350737:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166784.350752:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.350771:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446813568 00000100:00100000:2.0:1762166784.350774:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446813568 00000100:00100000:2.0:1762166784.350795:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1762166784.350798:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446813568:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1762166784.350806:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.350815:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c093 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0c08c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.350826:0:6499:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c093 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0c08c expref: 9 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.350833:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c093 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c08c expref: 9 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.350837:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff945cf39a3e00) 00010000:00010000:2.0:1762166784.350839:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166784.350841:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad400, rc 0) 00000100:00100000:2.0:1762166784.350863:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:30829:x1847765446813568:12345-0@lo:101:mdt00_005.0 Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.350866:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1762166784.350907:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446813568:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1762166784.350919:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.350928:0:30829:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1762166784.350942:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002bca3a8a reply state 00000000cb5acca6 transno 4294968920 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350953:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350957:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff945bc4077100) 00010000:00010000:0.0:1762166784.350959:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166784.350961:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166784.350965:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.350969:0:30829:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166784.350975:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x9:0x0] 00000004:00010000:0.0:1762166784.350977:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002bca3a8a reply state 00000000cb5acca6 transno 4294968920 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350982:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166784.350986:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:0.0:1762166784.350987:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166784.350988:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1762166784.350996:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00080000:0.0:1762166784.351000:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00010000:00010000:0.0:1762166784.351007:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.351012:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.351016:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.351028:0:30829:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1762166784.351030:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00010000:00010000:0.0:1762166784.351033:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.351037:0:30829:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.351048:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166784.351054:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.351060:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166784.351065:0:10256:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166784.351071:0:10256:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.351091:0:10256:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166784.351091:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:44793:x1847765440080512:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 6339us (6429us total) trans 4294968920 rc 0/0 00010000:00010000:1.0:1762166784.351103:0:10256:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1762166784.351103:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2725 00010000:00010000:1.0:1762166784.351128:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.351136:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0600/0x2f180c4effb0c062 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0c069 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166784.351145:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446813696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166784.351159:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166784.351164:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166784.351169:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166784.351184:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.351210:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446813696 00000100:00100000:1.0:1762166784.351214:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446813696 00000100:00100000:1.0:1762166784.351242:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1762166784.351248:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446813696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166784.351254:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166784.351262:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7c00/0x2f180c4effb0c069 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb0c062 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.351273:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166784.351280:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166784.351315:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446813696:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.351323:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1762166784.351404:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446813696:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1762166784.351679:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967453 is committed 00000004:00080000:0.0:1762166784.351686:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 15 committed 00000001:00080000:0.0:1762166784.351706:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967452 is committed 00000004:00080000:0.0:1762166784.351712:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 14 committed 00000004:00080000:0.0:1762166784.351720:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 11 committed 00010000:00010000:1.0:1762166784.351745:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.351755:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.351762:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.351770:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.351775:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166784.351778:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446813824:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1762166784.351788:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166784.351794:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446813952:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166784.351802:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:1.0:1762166784.351806:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166784.351817:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166784.351818:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.351826:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c7600/0x2f180c4effb0bc41 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166784.351846:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166784.351846:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.351855:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.351860:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.351866:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb5400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.351870:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166784.351871:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446813824 00000100:00100000:2.0:1762166784.351877:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446813824 00010000:00010000:1.0:1762166784.351879:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166784.351890:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446813952 00010000:00010000:1.0:1762166784.351891:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:1.0:1762166784.351894:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.351898:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166784.351901:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446813952 00010000:00010000:1.0:1762166784.351909:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb5400/0x2f180c4effb0bd4b lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00080000:0.0:1762166784.351910:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1762166784.351927:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166784.351933:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00010000:00010000:1.0:1762166784.351936:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166784.351954:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1762166784.351955:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446813824:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1762166784.351958:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.351967:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2c00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166784.351969:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446813952:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166784.351972:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00080000:2.0:1762166784.351979:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:29 count 1 00010000:00010000:1.0:1762166784.351981:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00002000:00080000:3.0:1762166784.351987:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:26 count 1 00010000:00010000:1.0:1762166784.351993:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:1.0:1762166784.351997:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166784.351998:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.352000:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166784.352004:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.352018:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0bdb4 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166784.352030:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 8 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166784.352034:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166784.352038:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166784.352047:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166784.352052:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166784.352057:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166784.352058:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.352058:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166784.352061:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166784.352067:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.352078:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.352090:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.352095:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166784.352101:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 8 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166784.352103:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.352122:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00010000:00010000:2.0:1762166784.352123:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 8 pid: 8382 timeout: 503 lvb_type: 1 00010000:00010000:3.0:1762166784.352125:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166784.352129:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.352135:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.352152:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0bf27 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166784.352156:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 7 pid: 28874 timeout: 503 lvb_type: 1 00000100:00100000:2.0:1762166784.352156:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446814080:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166784.352170:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166784.352178:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446814208:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166784.352179:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.352189:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.352195:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.352199:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.352205:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.352214:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0xba281655 (ffff945bc580ad00) 00000100:00100000:2.0:1762166784.352217:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399900 going to sleep for 11 seconds 00010000:00010000:1.0:1762166784.352217:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166784.352218:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe300 going to sleep for 11 seconds 00010000:00010000:1.0:1762166784.352224:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166784.352231:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0bf89 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x8:0x0].0xba281655 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166784.352971:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446814080:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166784.352991:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166784.353056:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446814208:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166784.353080:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166784.353108:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.353114:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440080896 00000100:00100000:2.0:1762166784.353119:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.353131:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440080896 00010000:00010000:1.0:1762166784.353148:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 8 pid: 28874 timeout: 503 lvb_type: 1 00000100:00100000:1.0:1762166784.353168:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440080768 00000100:00100000:1.0:1762166784.353171:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440080768 00000100:00100000:0.0:1762166784.353173:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 641 00000100:00100000:0.0:1762166784.353180:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:2417:x1847765440080896:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166784.353184:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 9 pid: 8382 timeout: 503 lvb_type: 1 00010000:00010000:0.0:1762166784.353189:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166784.353193:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 8 pid: 28874 timeout: 503 lvb_type: 1 00010000:00010000:0.0:1762166784.353203:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 8 pid: 28874 timeout: 503 lvb_type: 1 00000100:00100000:1.0:1762166784.353206:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 642 00000100:00100000:1.0:1762166784.353214:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440080768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166784.353220:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cacc00/0x2f180c4effb0bd3d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7b78 expref: 8 pid: 28874 timeout: 503 lvb_type: 1 00010000:00010000:1.0:1762166784.353221:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166784.353225:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 9 pid: 8382 timeout: 503 lvb_type: 1 00010000:00010000:0.0:1762166784.353230:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166784.353232:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166784.353233:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 9 pid: 8382 timeout: 503 lvb_type: 1 00010000:00010000:0.0:1762166784.353236:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.353244:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.353247:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0bf19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c04 expref: 9 pid: 8382 timeout: 503 lvb_type: 1 00010000:00010000:1.0:1762166784.353256:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166784.353257:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166784.353260:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.353266:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166784.353267:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.353294:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166784.353295:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:2417:x1847765440080896:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 115us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.353302:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 641 00010000:00010000:3.0:1762166784.353312:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.353314:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440080768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 100us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.353322:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 642 00010000:00010000:3.0:1762166784.353333:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.353341:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.353344:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.353353:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.353355:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.353372:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.353376:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.353386:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1762166784.353400:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1762166784.353402:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166784.353407:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.353417:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166784.353424:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166784.353425:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.353431:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.353435:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166784.353441:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.353443:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.353464:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.353468:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.353505:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.353511:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0c09a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.353520:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7e00/0x2f180c4effb0c0a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.353525:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166784.353528:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166784.353530:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.353538:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.353541:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.353544:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166784.353623:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446813824:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1674us (1807us total) trans 21474836676 rc 0/0 00000100:00100000:1.0:1762166784.353631:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000004:00080000:0.0:1762166784.353642:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef7100/2, rc 0, transno 21474836676 00000100:00100000:0.0:1762166784.353648:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446813824:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166784.353664:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446813952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1698us (1818us total) trans 17179869359 rc 0/0 00000100:00100000:3.0:1762166784.353671:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000004:00080000:2.0:1762166784.353683:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e8e00/2, rc 0, transno 17179869359 00000100:00100000:2.0:1762166784.353696:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446813952:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1762166784.357837:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.357881:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440081024 00000100:00100000:1.0:1762166784.357886:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440081024 00000100:00100000:1.0:1762166784.357918:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2726 00000100:00100000:1.0:1762166784.357926:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:44794:x1847765440081024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.357942:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.357959:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0c0a8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c58 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.358021:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.358029:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.358035:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.358040:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.358047:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0c077 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c070 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.358052:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.358070:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0c077 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0c070 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.358078:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765446814336:0@lo:104: 00000100:00100000:1.0:1762166784.358102:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.358129:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.358135:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446814336 00000100:00100000:2.0:1762166784.358140:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446814336 00000100:00100000:2.0:1762166784.358168:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1762166784.358172:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:30829:x1847765446814336:12345-0@lo:104: 00010000:00010000:2.0:1762166784.358181:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.358231:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1762166784.358236:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:30829:x1847765446814336:12345-0@lo:104: Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.358241:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1762166784.358247:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765446814336:0@lo:104: 00010000:00010000:3.0:1762166784.358256:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166784.358261:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.358263:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.358272:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:3.0:1762166784.358276:0:7420:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1762166784.358282:0:7420:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.358300:0:7420:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.358312:0:7420:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1762166784.358330:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.358335:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bc60b0800/0x2f180c4effb0c070 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c077 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.358341:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446814464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166784.358347:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166784.358350:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166784.358351:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166784.358364:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166784.358395:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446814464 00000100:00100000:3.0:1762166784.358399:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446814464 00010000:00010000:3.0:1762166784.358411:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0c077 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0c070 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166784.358430:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1762166784.358434:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446814464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166784.358441:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166784.358668:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3caca00/0x2f180c4effb0c077 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0c070 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.358676:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff945cf39a3500) 00010000:00010000:3.0:1762166784.358679:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.358684:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.358687:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.358706:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166784.358728:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166784.358734:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446814464:12345-0@lo:103:ldlm_bl.0 Request processed in 299us (370us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166784.358739:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166784.358742:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1762166784.358774:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446814464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166784.358819:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:30829:1847765446814592:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.358842:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.358857:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.358878:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446814592 00000100:00100000:2.0:1762166784.358883:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446814592 00000100:00100000:2.0:1762166784.358912:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1762166784.358920:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:30829:x1847765446814592:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1762166784.358980:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:30829:x1847765446814592:12345-0@lo:1000:mdt00_005.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.358990:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1762166784.358990:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:30829:1847765446814592:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1762166784.359019:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0c0bd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.359025:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0c0bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359030:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0c0bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:1.0:1762166784.359041:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0c0bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359049:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359052:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359056:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359059:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359062:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.359069:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359072:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359078:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634100) 00010000:00010000:1.0:1762166784.359080:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.359082:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359085:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c0af lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359091:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359094:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359097:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359100:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.359102:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359105:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359108:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff945cf39a3500) 00010000:00010000:1.0:1762166784.359109:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.359111:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359122:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c0b6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.359148:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0c0a8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c58 expref: 14 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.359163:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0c0bd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c58 expref: 13 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.359170:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd4634f00) 00010000:00010000:1.0:1762166784.359172:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166784.359174:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1a00, rc 0) 00000100:00100000:1.0:1762166784.359206:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:44794:x1847765440081024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1282us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.359210:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2726 00000100:00100000:2.0:1762166784.360087:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.360115:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440081152 00000100:00100000:1.0:1762166784.360119:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440081152 00000100:00100000:1.0:1762166784.360142:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2727 00000100:00100000:1.0:1762166784.360146:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:44794:x1847765440081152:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.360154:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.360162:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c0c4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c5f expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.360180:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0c0cb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.360185:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0c0cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.360198:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0c0cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000004:00200000:1.0:1762166784.360253:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1762166784.360257:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1762166784.360272:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c0c4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c5f expref: 19 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.360280:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0c0cb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c5f expref: 18 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.360284:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166784.360286:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166784.360287:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0200, rc 0) 00000100:00100000:1.0:1762166784.360312:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:44794:x1847765440081152:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 164us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.360318:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2727 00000100:00100000:2.0:1762166784.360981:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.361011:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440081280 00000100:00100000:1.0:1762166784.361015:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440081280 00000100:00100000:1.0:1762166784.361035:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2728 00000100:00100000:1.0:1762166784.361039:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:44794:x1847765440081280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.361046:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.361052:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0c0d2 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c66 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.361069:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c0d9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.361075:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.361084:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000004:00200000:1.0:1762166784.361099:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1762166784.361102:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1762166784.361113:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0c0d2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c66 expref: 20 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.361120:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c66 expref: 19 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.361125:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff945bc4077100) 00010000:00010000:1.0:1762166784.361126:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166784.361128:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1c00, rc 0) 00000100:00100000:1.0:1762166784.361149:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:44794:x1847765440081280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 109us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.361152:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2728 00000100:00100000:0.0:1762166784.361829:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.361870:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440081408 00000100:00100000:1.0:1762166784.361875:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440081408 00000100:00100000:1.0:1762166784.361904:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2729 00000100:00100000:1.0:1762166784.361912:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:44794:x1847765440081408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.361920:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.361929:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c0e0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c6d expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.361954:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.361963:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c093 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c08c expref: 5 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.361976:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.361994:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c093 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0c08c expref: 5 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.362003:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765446814720:0@lo:104: 00000100:00100000:1.0:1762166784.362026:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.362056:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.362061:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446814720 00000100:00100000:2.0:1762166784.362065:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446814720 00000100:00100000:2.0:1762166784.362088:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1762166784.362092:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:30829:x1847765446814720:12345-0@lo:104: 00010000:00010000:2.0:1762166784.362099:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.362140:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1762166784.362147:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:30829:x1847765446814720:12345-0@lo:104: Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.362156:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:0.0:1762166784.362160:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1762166784.362161:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765446814720:0@lo:104: 00010000:00010000:0.0:1762166784.362166:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.362173:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89e00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:0.0:1762166784.362176:0:10257:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.362179:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:0.0:1762166784.362197:0:10257:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.362217:0:10257:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 2/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.362223:0:10257:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1762166784.362246:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 1/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.362254:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bccb89e00/0x2f180c4effb0c08c lrc: 0/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c093 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166784.362259:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446814848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166784.362277:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.362280:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.362283:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166784.362287:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.362320:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446814848 00000100:00100000:1.0:1762166784.362324:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446814848 00010000:00010000:1.0:1762166784.362339:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c093 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0c08c expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.362366:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1762166784.362374:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446814848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166784.362382:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166784.362594:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c093 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0c08c expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.362604:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff945cf39a3e00) 00010000:00010000:1.0:1762166784.362607:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.362623:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.362628:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.362647:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166784.362661:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166784.362667:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166784.362680:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446814848:12345-0@lo:103:ldlm_bl.0 Request processed in 306us (391us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166784.362688:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x9:0x0]: returning size 4096 00000100:00100000:1.0:1762166784.362689:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000004:00200000:0.0:1762166784.362693:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1762166784.362696:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446814848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166784.362713:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c0e0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c6d expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.362722:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c6d expref: 14 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.362741:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff945cf39a3e00) 00010000:00010000:0.0:1762166784.362745:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166784.362747:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1400, rc 0) 00000100:00100000:0.0:1762166784.362771:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44794:x1847765440081408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 861us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.362775:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2729 00000100:00100000:2.0:1762166784.364219:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166784.364258:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440081664 00000100:00100000:0.0:1762166784.364263:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440081664 00000100:00100000:0.0:1762166784.364292:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2730 00000100:00100000:0.0:1762166784.364300:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:44794:x1847765440081664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166784.364308:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166784.364317:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c0ee lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c74 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166784.364383:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1762166784.364451:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c0ee lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c74 expref: 21 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.364460:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:0.0:1762166784.364462:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166784.364464:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c0ee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c74 expref: 21 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.364471:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89200, rc 0) 00000100:00100000:0.0:1762166784.364536:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:44794:x1847765440081664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 236us (316us total) trans 4294968921 rc 301/301 00000100:00100000:0.0:1762166784.364551:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2730 00000100:00100000:2.0:1762166784.365536:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.365577:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440081920 00000100:00100000:1.0:1762166784.365581:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440081920 00000100:00100000:1.0:1762166784.365605:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2731 00000100:00100000:1.0:1762166784.365610:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:44794:x1847765440081920:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166784.365632:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166784.365643:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0c0cb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c5f expref: 20 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.365652:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166784.365654:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166784.365662:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 3/0,1 mode: --/PW res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.365668:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.365672:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000040:00080000:1.0:1762166784.365838:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].22, 456 off52120 00000040:00080000:1.0:1762166784.365874:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].10, 536 off49560 00000004:00080000:1.0:1762166784.365879:0:30829:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc4446e40 with version 20 00000004:00080000:2.0:1762166784.365913:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 20 rpc_version 20 00000020:00100000:2.0:1762166784.365932:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1762166784.365937:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc5f5e680 x1847765446815104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166784.365953:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446815104:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166784.365985:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166784.366008:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.366023:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446815104 00000100:00100000:0.0:1762166784.366028:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446815104 00000100:00100000:0.0:1762166784.366057:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1762166784.366064:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8087:x1847765446815104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166784.366274:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8087:x1847765446815104:12345-0@lo:1000:osp_up1-0.0 Request processed in 211us (288us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1762166784.366279:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1762166784.366309:0:8087:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967453 gen 2 00000004:00080000:2.0:1762166784.366315:0:8087:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967453 committed transno 4294967453 00000100:00100000:2.0:1762166784.366335:0:8087:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5f5e680 x1847765446815104/t4294967454(4294967454) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1520/4320 e 0 to 0 dl 1762166800 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1762166784.366359:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446815104:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1762166784.366401:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009e2b60be reply state 0000000006c281f3 transno 4294968922 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.366416:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.366424:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166784.366427:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1762166784.366430:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1762166784.366435:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000100:00100000:1.0:1762166784.366513:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:44794:x1847765440081920:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 899us (977us total) trans 4294968922 rc 0/0 00000100:00100000:1.0:1762166784.366523:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2731 00000100:00100000:1.0:1762166784.367250:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.367296:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440082176 00000100:00100000:2.0:1762166784.367302:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440082176 00000100:00100000:2.0:1762166784.367333:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 787 00000100:00100000:2.0:1762166784.367342:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:44794:x1847765440082176:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166784.367454:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:44794:x1847765440082176:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 114us (205us total) trans 4294968923 rc 0/0 00000100:00100000:2.0:1762166784.367461:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 787 00000100:00100000:2.0:1762166784.401088:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.401157:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440082304 00000100:00100000:1.0:1762166784.401169:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440082304 00000100:00100000:1.0:1762166784.401227:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2732 00000100:00100000:1.0:1762166784.401239:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44803:x1847765440082304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.401260:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.401283:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c103 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c7b expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.401351:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.401364:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401374:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401451:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.401460:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401467:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401557:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401565:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401571:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401578:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401583:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.401587:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401594:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401604:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634100) 00010000:00010000:1.0:1762166784.401607:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.401612:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401619:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0c10a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401642:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401647:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401653:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401658:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.401661:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401667:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401675:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x892874e3 (ffff945cd4634400) 00010000:00010000:1.0:1762166784.401678:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.401681:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401686:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0c111 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.401721:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c103 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c7b expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.401731:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634100) 00010000:00010000:1.0:1762166784.401733:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.401737:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0c103 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c7b expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.401760:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0200, rc 0) 00000100:00100000:1.0:1762166784.401821:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44803:x1847765440082304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 584us (740us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166784.401828:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2732 00000100:00100000:3.0:1762166784.403293:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.403335:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440082432 00000100:00100000:1.0:1762166784.403342:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440082432 00000100:00100000:1.0:1762166784.403380:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2733 00000100:00100000:1.0:1762166784.403389:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44803:x1847765440082432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.403401:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.403416:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0c118 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c82 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.403455:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.403464:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403473:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403516:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.403523:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403530:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403564:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403571:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403577:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403583:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403587:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.403590:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403596:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403605:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634e00) 00010000:00010000:1.0:1762166784.403607:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.403611:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403617:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0c11f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403626:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403632:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403637:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403647:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.403650:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403656:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403664:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x892874e3 (ffff945cd4634600) 00010000:00010000:1.0:1762166784.403666:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.403669:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403675:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0c126 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.403700:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0c118 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c82 expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.403709:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634e00) 00010000:00010000:1.0:1762166784.403712:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.403715:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0c118 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c82 expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.403725:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:1.0:1762166784.403767:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44803:x1847765440082432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 379us (476us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166784.403774:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2733 00000100:00100000:0.0:1762166784.405068:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.405106:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440082560 00000100:00100000:1.0:1762166784.405111:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440082560 00000100:00100000:1.0:1762166784.405153:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2734 00000100:00100000:1.0:1762166784.405162:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44803:x1847765440082560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.405174:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.405188:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c12d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c89 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.405239:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.405247:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.405252:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:1.0:1762166784.405289:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1762166784.405294:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1762166784.405324:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0c12d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 16 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.405339:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.405347:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634000) 00010000:00010000:1.0:1762166784.405350:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166784.405352:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14600, rc 0) 00000100:00100000:1.0:1762166784.405386:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:44803:x1847765440082560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 226us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.405391:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2734 00000100:00100000:2.0:1762166784.407642:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.407677:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440082816 00000100:00100000:1.0:1762166784.407690:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440082816 00000100:00100000:1.0:1762166784.407726:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2735 00000100:00100000:1.0:1762166784.407732:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:44803:x1847765440082816:12345-192.168.204.38@tcp:36:lfs.0 00000100:00100000:1.0:1762166784.407830:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446815232:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.407869:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166784.407915:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446815232 00000100:00100000:1.0:1762166784.407917:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.407920:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446815232 00000100:00100000:0.0:1762166784.407975:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1762166784.407985:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:30829:x1847765446815232:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1762166784.408046:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:30829:x1847765446815232:12345-0@lo:1000:mdt00_005.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.408052:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1762166784.408073:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446815232:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.408106:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446815360:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.408121:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.408137:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.408160:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446815360 00000100:00100000:0.0:1762166784.408164:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446815360 00000100:00100000:0.0:1762166784.408184:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1762166784.408188:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:30829:x1847765446815360:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1762166784.408243:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:30829:x1847765446815360:12345-0@lo:1000:mdt00_005.0 Request processed in 54us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166784.408248:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1762166784.408261:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446815360:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1762166784.408303:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.408312:0:30829:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.408321:0:30829:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 30829 initiator: MDT0 00000100:00100000:1.0:1762166784.408332:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446815488:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1762166784.408354:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.408375:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.408409:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446815488 00000100:00100000:0.0:1762166784.408415:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446815488 00000100:00100000:0.0:1762166784.408438:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1762166784.408449:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:30829:x1847765446815488:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1762166784.408457:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166784.408467:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0c13b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.408519:0:6499:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 14 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.408527:0:6499:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0c13b expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.408545:0:6499:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 14 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.408555:0:6499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 14 pid: 30829 timeout: 503 lvb_type: 0 00000100:00100000:0.0:1762166784.408565:0:6499:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cc380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6499:1847765446815616:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166784.408612:0:6499:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.409705:0:6499:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cc380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6499:1847765446815616:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166784.409722:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c13b expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.409732:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634000) 00010000:00010000:0.0:1762166784.409735:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166784.409738:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c13b expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.409757:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89e00, rc 0) 00000100:00100000:0.0:1762166784.409795:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446815488:12345-0@lo:101:mdt00_005.0 Request processed in 1345us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.409802:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:1.0:1762166784.409823:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446815488:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1762166784.409835:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 4/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.409842:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 4/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166784.410036:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.410073:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440082944 00000100:00100000:1.0:1762166784.410078:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440082944 00010000:00010000:1.0:1762166784.410097:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 15 pid: 30829 timeout: 503 lvb_type: 0 00000100:00100000:1.0:1762166784.410128:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 645 00000100:00100000:1.0:1762166784.410136:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440082944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166784.410147:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166784.410153:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 15 pid: 30829 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166784.410165:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 15 pid: 30829 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166784.410178:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c134 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c89 expref: 15 pid: 30829 timeout: 503 lvb_type: 0 00010000:00010000:1.0:1762166784.410187:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634000) 00010000:00010000:1.0:1762166784.410190:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c13b expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.410196:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0c13b expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.410201:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0c13b expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.410228:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c13b expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.410234:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:8398:1847765446815744:0@lo:105: 00000100:00100000:1.0:1762166784.410253:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.410274:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166784.410296:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446815744 00000100:00100000:2.0:1762166784.410302:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446815744 00000100:00100000:2.0:1762166784.410333:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1762166784.410348:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8398:x1847765446815744:12345-0@lo:105: 00010000:00010000:2.0:1762166784.410359:0:8397:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.410368:0:8397:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.410378:0:8397:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.410385:0:8397:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.410391:0:8397:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.410399:0:8397:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.410420:0:8397:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945d00f14400) 00010000:00010000:1.0:1762166784.410435:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.410442:0:30829:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166784.410455:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000100:00100000:2.0:1762166784.410463:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8398:x1847765446815744:12345-0@lo:105: Request processed in 116us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.410472:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:1.0:1762166784.410473:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.410510:0:30829:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.410517:0:30829:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 30829 initiator: MDT0 00000100:00100000:1.0:1762166784.410528:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446815872:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1762166784.410537:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:8398:1847765446815744:0@lo:105: 00000100:00100000:1.0:1762166784.410552:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166784.410555:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166784.410572:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166784.410589:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440082944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 453us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.410591:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446815872 00000100:00100000:0.0:1762166784.410596:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446815872 00000100:00100000:3.0:1762166784.410597:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 645 00000100:00100000:0.0:1762166784.410627:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1762166784.410635:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:30829:x1847765446815872:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1762166784.410646:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166784.410659:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89200/0x2f180c4effb0c150 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0c149 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.410674:0:6499:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89200/0x2f180c4effb0c150 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0c149 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.410681:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89200/0x2f180c4effb0c150 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c149 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.410686:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x892874e3 (ffff945bc4077400) 00010000:00010000:0.0:1762166784.410688:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166784.410689:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89200, rc 0) 00000100:00100000:0.0:1762166784.410724:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446815872:12345-0@lo:101:mdt00_005.0 Request processed in 90us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.410729:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1762166784.410759:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446815872:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1762166784.410772:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.410794:0:30829:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166784.410805:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000100:00100000:1.0:1762166784.410830:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816000:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.410854:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.410877:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.410905:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446816000 00000100:00100000:0.0:1762166784.410910:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446816000 00000100:00100000:0.0:1762166784.410939:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1762166784.410951:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816000:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1762166784.411012:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816000:12345-0@lo:1000:mdt00_005.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.411016:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1762166784.411041:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816000:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.411067:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816128:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.411082:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.411098:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.411112:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446816128 00000100:00100000:0.0:1762166784.411115:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446816128 00000100:00100000:0.0:1762166784.411154:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1762166784.411161:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816128:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1762166784.411215:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816128:12345-0@lo:1000:mdt00_005.0 Request processed in 55us (131us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166784.411219:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1762166784.411242:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816128:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.411312:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816256:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.411333:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.411352:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.411362:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446816256 00000100:00100000:0.0:1762166784.411366:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446816256 00000100:00100000:0.0:1762166784.411383:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1762166784.411387:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816256:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1762166784.411426:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816256:12345-0@lo:1000:mdt00_005.0 Request processed in 38us (92us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166784.411431:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1762166784.411442:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816256:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.411501:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816384:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.411519:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.411532:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.411541:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446816384 00000100:00100000:0.0:1762166784.411544:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446816384 00000100:00100000:0.0:1762166784.411563:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1762166784.411567:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816384:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1762166784.411605:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816384:12345-0@lo:1000:mdt00_005.0 Request processed in 37us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.411610:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1762166784.411618:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816384:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.411646:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816512:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1762166784.411660:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.411674:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.411677:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446816512 00000100:00100000:0.0:1762166784.411680:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446816512 00000100:00100000:0.0:1762166784.411707:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1762166784.411712:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816512:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1762166784.411758:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:30829:x1847765446816512:12345-0@lo:1000:mdt00_005.0 Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.411765:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1762166784.411776:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816512:0@lo:1000:mdt00_005.0 00000040:00080000:1.0:1762166784.412550:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].23, 2152 off54272 00000040:00080000:1.0:1762166784.412622:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].11, 2352 off51912 00000004:00080000:1.0:1762166784.412627:0:30829:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc4076900 with version 21 00000004:00080000:2.0:1762166784.412661:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 21 rpc_version 21 00000020:00100000:2.0:1762166784.412683:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1762166784.412688:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc5f5fb80 x1847765446816768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166784.412698:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446816768:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166784.412721:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166784.412748:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.412775:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446816768 00000100:00100000:0.0:1762166784.412780:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446816768 00000100:00100000:0.0:1762166784.412805:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1762166784.412812:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8087:x1847765446816768:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166784.413257:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8087:x1847765446816768:12345-0@lo:1000:osp_up1-0.0 Request processed in 445us (533us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1762166784.413265:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1762166784.413305:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446816768:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1762166784.413379:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413389:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413395:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413404:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 3/0,1 mode: --/PW res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413408:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413412:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413425:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413429:0:30829:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413433:0:30829:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 30829 initiator: MDT0 00000100:00100000:1.0:1762166784.413442:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816896:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1762166784.413459:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.413502:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7d136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.413507:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446816896 00000100:00100000:0.0:1762166784.413512:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446816896 00000100:00100000:0.0:1762166784.413535:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1762166784.413540:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:30829:x1847765446816896:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1762166784.413548:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166784.413558:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88000/0x2f180c4effb0c16c lrc: 2/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0c165 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.413570:0:6499:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88000/0x2f180c4effb0c16c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0c165 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.413577:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88000/0x2f180c4effb0c16c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c165 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.413582:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff945bc4077f00) 00010000:00010000:0.0:1762166784.413584:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166784.413590:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88000, rc 0) 00000100:00100000:0.0:1762166784.413616:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:30829:x1847765446816896:12345-0@lo:101:mdt00_005.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.413621:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1762166784.413654:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:30829:1847765446816896:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1762166784.413666:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.413676:0:30829:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166784.413690:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ba229cc4 reply state 0000000013b9015a transno 4294968924 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413700:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413717:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff945cd4634b00) 00010000:00010000:1.0:1762166784.413723:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166784.413726:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166784.413731:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.413738:0:30829:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166784.413747:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0xa:0x0] 00000004:00010000:1.0:1762166784.413752:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ba229cc4 reply state 0000000013b9015a transno 4294968924 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413759:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.413764:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166784.413766:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166784.413768:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1762166784.413778:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00080000:1.0:1762166784.413784:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00010000:00010000:1.0:1762166784.413789:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.413796:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.413803:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.413825:0:30829:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1762166784.413829:0:30829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00010000:00010000:1.0:1762166784.413834:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.413841:0:30829:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.413844:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166784.413853:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.413862:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14400 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:2.0:1762166784.413868:0:10256:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166784.413876:0:10256:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.413899:0:10256:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 2/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.413905:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:44803:x1847765440082816:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 6170us (6263us total) trans 4294968924 rc 0/0 00010000:00010000:2.0:1762166784.413912:0:10256:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1762166784.413917:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2735 00010000:00010000:2.0:1762166784.413946:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 1/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.413952:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14400/0x2f180c4effb0c13b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0c142 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.413958:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166784.413970:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446817024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166784.413973:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166784.413976:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166784.413978:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166784.414017:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166784.414140:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446817024 00000100:00100000:3.0:1762166784.414145:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446817024 00000100:00100000:3.0:1762166784.414178:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1762166784.414186:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765446817024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166784.414195:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166784.414208:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c142 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb0c13b expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.414221:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634000) 00010000:00010000:3.0:1762166784.414228:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166784.414263:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446817024:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.414270:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1762166784.414287:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446817024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166784.421269:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.421312:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440083200 00000100:00100000:1.0:1762166784.421320:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440083200 00000100:00100000:1.0:1762166784.421371:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2736 00000100:00100000:1.0:1762166784.421381:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44804:x1847765440083200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166784.421413:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166784.421430:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c173 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c90 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.421516:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.421527:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421534:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421542:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.421546:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421550:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421593:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c188 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166784.421597:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421601:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c188 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421610:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421614:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421623:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421627:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421630:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.421633:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421637:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421645:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634e00) 00010000:00010000:1.0:1762166784.421647:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.421650:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421654:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c17a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421662:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421665:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421668:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421671:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166784.421673:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421684:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421688:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff945cd4634600) 00010000:00010000:1.0:1762166784.421690:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166784.421691:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421694:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14200/0x2f180c4effb0c181 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166784.421719:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c173 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c90 expref: 16 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.421727:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c188 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c90 expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.421731:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd4634f00) 00010000:00010000:1.0:1762166784.421732:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166784.421734:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14000, rc 0) 00000100:00100000:1.0:1762166784.421793:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:44804:x1847765440083200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 413us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.421800:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2736 00000100:00100000:0.0:1762166784.423255:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166784.423263:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166784.423284:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440083584 00000100:00100000:3.0:1762166784.423289:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440083584 00000100:00100000:2.0:1762166784.423297:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440083456 00000100:00100000:2.0:1762166784.423303:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440083456 00000100:00100000:3.0:1762166784.423329:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 284 00000100:00100000:3.0:1762166784.423338:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440083584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166784.423347:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2737 00010000:00010000:3.0:1762166784.423348:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166784.423362:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:44804:x1847765440083456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166784.423365:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c188 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c90 expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.423381:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd4634f00) 00010000:00010000:3.0:1762166784.423385:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166784.423389:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.423404:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0c18f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c97 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166784.423413:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440083584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 78us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.423419:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 284 00000004:00200000:2.0:1762166784.423546:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00010000:00010000:2.0:1762166784.423622:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0c18f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c97 expref: 26 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.423630:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:2.0:1762166784.423633:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166784.423637:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac000/0x2f180c4effb0c18f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c97 expref: 26 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.423645:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac000, rc 0) 00000100:00100000:2.0:1762166784.423675:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:44804:x1847765440083456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 317us (425us total) trans 4294968925 rc 301/301 00000100:00100000:2.0:1762166784.423681:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2737 00000100:00100000:0.0:1762166784.424814:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.424852:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440083840 00000100:00100000:2.0:1762166784.424857:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440083840 00000100:00100000:2.0:1762166784.424889:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 788 00000100:00100000:2.0:1762166784.424897:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:44804:x1847765440083840:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166784.425015:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:44804:x1847765440083840:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 120us (204us total) trans 4294968926 rc 0/0 00000100:00100000:2.0:1762166784.425021:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 788 00000100:00100000:1.0:1762166784.426281:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.426344:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440084096 00000100:00100000:2.0:1762166784.426387:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440084096 00000100:00100000:2.0:1762166784.426446:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2738 00000100:00100000:2.0:1762166784.426470:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:44804:x1847765440084096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166784.426546:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.426568:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0c19d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c9e expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.426721:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0c1a4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.426737:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0c1a4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.426748:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0c1a4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000004:00200000:2.0:1762166784.426758:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00010000:00010000:2.0:1762166784.426843:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0c19d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c9e expref: 29 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.426861:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0c1a4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c9e expref: 28 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.426869:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:2.0:1762166784.426873:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166784.426876:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cacc00, rc 0) 00000100:00100000:2.0:1762166784.426931:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:44804:x1847765440084096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 463us (660us total) trans 4294968927 rc 0/0 00000100:00100000:2.0:1762166784.426938:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2738 00000100:00100000:0.0:1762166784.428087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.428130:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440084224 00000100:00100000:2.0:1762166784.428137:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440084224 00000100:00100000:2.0:1762166784.428186:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 789 00000100:00100000:2.0:1762166784.428206:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:44804:x1847765440084224:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:2.0:1762166784.428269:0:13556:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1762166784.428273:0:13556:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1762166784.428317:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:44804:x1847765440084224:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 114us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.428323:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 789 00000100:00100000:0.0:1762166784.429340:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.429386:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440084352 00000100:00100000:2.0:1762166784.429395:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440084352 00000100:00100000:2.0:1762166784.429435:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2739 00000100:00100000:2.0:1762166784.429444:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:44804:x1847765440084352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166784.429462:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.429514:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0c1b2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ca5 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.429577:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0c1b9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.429587:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0c1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.429595:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0c1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000004:00200000:2.0:1762166784.429662:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1762166784.429667:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1762166784.429684:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0c1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.429705:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0c1b2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ca5 expref: 30 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.429741:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0c1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ca5 expref: 29 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.429751:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:2.0:1762166784.429754:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166784.429757:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cade00, rc 0) 00000100:00100000:2.0:1762166784.429814:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:44804:x1847765440084352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 370us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.429821:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2739 00000100:00100000:1.0:1762166784.431323:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.431393:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440084480 00000100:00100000:2.0:1762166784.431402:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440084480 00000100:00100000:2.0:1762166784.431454:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2740 00000100:00100000:2.0:1762166784.431464:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:44804:x1847765440084480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166784.431519:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.431539:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0c1c0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cac expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.431592:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.431602:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.431611:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.431622:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.431645:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89200/0x2f180c4effb0c150 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c149 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.431653:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.431683:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89200/0x2f180c4effb0c150 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0c149 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166784.431697:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765446817152:0@lo:104: 00000100:00100000:2.0:1762166784.431764:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.431822:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446817152 00000100:00100000:2.0:1762166784.431826:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166784.431832:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446817152 00000100:00100000:1.0:1762166784.431892:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1762166784.431915:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:30829:x1847765446817152:12345-0@lo:104: 00010000:00010000:1.0:1762166784.431933:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.432022:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1762166784.432031:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:30829:x1847765446817152:12345-0@lo:104: Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.432042:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:3.0:1762166784.432057:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1762166784.432064:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765446817152:0@lo:104: 00010000:00010000:3.0:1762166784.432072:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.432086:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14c00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:3.0:1762166784.432094:0:6482:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.432095:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:3.0:1762166784.432135:0:6482:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.432173:0:6482:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.432180:0:6482:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1762166784.432217:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.432232:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14c00/0x2f180c4effb0c149 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c150 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166784.432241:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446817280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166784.432259:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166784.432263:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166784.432266:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166784.432281:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166784.432321:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446817280 00000100:00100000:3.0:1762166784.432327:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446817280 00010000:00010000:3.0:1762166784.432352:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89200/0x2f180c4effb0c150 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0c149 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166784.432383:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1762166784.432390:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446817280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166784.432403:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1762166784.433953:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967455 is committed 00010000:00010000:3.0:1762166784.434057:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89200/0x2f180c4effb0c150 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0c149 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.434080:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x892874e3 (ffff945bc4077400) 00010000:00010000:3.0:1762166784.434085:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.434096:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.434104:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.434143:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166784.434179:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434190:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166784.434208:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446817280:12345-0@lo:103:ldlm_bl.0 Request processed in 1817us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.434227:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1762166784.434278:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446817280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166784.434329:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:30829:1847765446817408:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1762166784.434373:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166784.434405:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.434467:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446817408 00000100:00100000:0.0:1762166784.434474:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446817408 00000100:00100000:0.0:1762166784.434561:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1762166784.434573:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:30829:x1847765446817408:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1762166784.434668:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:30829:x1847765446817408:12345-0@lo:1000:mdt00_005.0 Request processed in 99us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166784.434682:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1762166784.434691:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:30829:1847765446817408:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1762166784.434745:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0c1d5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.434769:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0c1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434778:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0c1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:2.0:1762166784.434803:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0c1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434820:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434827:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434834:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434840:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434845:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166784.434849:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434856:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434864:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cf39a3400) 00010000:00010000:2.0:1762166784.434867:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166784.434870:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434876:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0c1c7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434894:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434899:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434904:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434908:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166784.434910:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434914:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434920:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x892874e3 (ffff945bc4077400) 00010000:00010000:2.0:1762166784.434923:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166784.434926:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434931:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad400/0x2f180c4effb0c1ce lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.434969:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0c1c0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cac expref: 16 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.434988:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0c1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cac expref: 15 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.434995:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cf39a3d00) 00010000:00010000:2.0:1762166784.435002:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166784.435005:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac000, rc 0) 00000100:00100000:2.0:1762166784.435074:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:44804:x1847765440084480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3612us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.435082:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2740 00000100:00100000:0.0:1762166784.436892:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.436960:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440084608 00000100:00100000:2.0:1762166784.436970:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440084608 00000100:00100000:2.0:1762166784.437028:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2741 00000100:00100000:2.0:1762166784.437038:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:44804:x1847765440084608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166784.437060:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.437083:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0c1dc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cb3 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.437156:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0c1e3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.437170:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0c1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.437184:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0c1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000004:00200000:2.0:1762166784.437286:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1762166784.437292:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1762166784.437327:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad000/0x2f180c4effb0c1dc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cb3 expref: 31 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.437346:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0c1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cb3 expref: 30 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.437356:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:2.0:1762166784.437384:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166784.437389:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00000100:00100000:2.0:1762166784.437454:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+30:44804:x1847765440084608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 417us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.437461:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2741 00000100:00100000:0.0:1762166784.439092:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.439158:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440084736 00000100:00100000:2.0:1762166784.439171:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440084736 00000100:00100000:2.0:1762166784.439229:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2742 00000100:00100000:2.0:1762166784.439240:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+30:44804:x1847765440084736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166784.439264:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.439282:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0c1ea lrc: 2/0,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cba expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.439352:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0c1f1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.439365:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0c1f1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.439377:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0c1f1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000004:00200000:2.0:1762166784.439444:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1762166784.439451:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1762166784.439539:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0c1ea lrc: 0/0,0 mode: --/CR res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cba expref: 32 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.439560:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0c1f1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cba expref: 31 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.439569:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff945cd4634b00) 00010000:00010000:2.0:1762166784.439587:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166784.439591:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477200, rc 0) 00000100:00100000:2.0:1762166784.439659:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:44804:x1847765440084736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 421us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.439667:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2742 00000100:00100000:1.0:1762166784.440876:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.440933:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440084864 00000100:00100000:2.0:1762166784.440944:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440084864 00000100:00100000:2.0:1762166784.441002:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2743 00000100:00100000:2.0:1762166784.441014:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:44804:x1847765440084864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166784.441034:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.441059:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c1f8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cc1 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.441119:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.441134:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88000/0x2f180c4effb0c16c lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0c165 expref: 5 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.441144:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 4/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.441183:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88000/0x2f180c4effb0c16c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0c165 expref: 5 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166784.441203:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765446817536:0@lo:104: 00000100:00100000:2.0:1762166784.441262:0:30829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166784.441320:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166784.441329:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446817536 00000100:00100000:1.0:1762166784.441341:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446817536 00000100:00100000:1.0:1762166784.441406:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1762166784.441420:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:30829:x1847765446817536:12345-0@lo:104: 00010000:00010000:1.0:1762166784.441437:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166784.441534:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1762166784.441541:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:30829:x1847765446817536:12345-0@lo:104: Request processed in 123us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166784.441551:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:0.0:1762166784.441589:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1762166784.441591:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765446817536:0@lo:104: 00010000:00010000:0.0:1762166784.441601:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.441614:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14a00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:0.0:1762166784.441624:0:6483:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1762166784.441636:0:6483:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.441643:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166784.441686:0:6483:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.441694:0:6483:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1762166784.441728:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166784.441736:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945d00f14a00/0x2f180c4effb0c165 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0c16c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166784.441744:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446817664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166784.441772:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.441776:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166784.441779:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166784.441791:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166784.441839:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446817664 00000100:00100000:3.0:1762166784.441844:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446817664 00010000:00010000:3.0:1762166784.441872:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88000/0x2f180c4effb0c16c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0c165 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166784.441901:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1762166784.441909:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446817664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166784.441921:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166784.442276:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88000/0x2f180c4effb0c16c lrc: 0/0,0 mode: --/PW res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0c165 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166784.442289:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff945bc4077f00) 00010000:00010000:3.0:1762166784.442293:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 3/1,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.442300:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.442306:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166784.442335:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166784.442370:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166784.442378:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166784.442389:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446817664:12345-0@lo:103:ldlm_bl.0 Request processed in 479us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166784.442398:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000004:00200000:2.0:1762166784.442435:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1762166784.442441:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1762166784.442532:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c1f8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cc1 expref: 17 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.442552:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cc1 expref: 16 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.442562:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff945bc4077f00) 00000100:00100000:1.0:1762166784.442563:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446817664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166784.442573:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166784.442580:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476200, rc 0) 00000100:00100000:2.0:1762166784.442649:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:44804:x1847765440084864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1636us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.442657:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2743 00000100:00100000:0.0:1762166784.444808:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.444863:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440085120 00000100:00100000:2.0:1762166784.444871:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440085120 00000100:00100000:2.0:1762166784.444928:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2744 00000100:00100000:2.0:1762166784.444939:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:44804:x1847765440085120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166784.444983:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166784.445004:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0c206 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cc8 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762166784.445150:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1762166784.445239:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0c206 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cc8 expref: 33 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.445253:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:2.0:1762166784.445256:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166784.445261:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0c206 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cc8 expref: 33 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.445274:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477800, rc 0) 00000100:00100000:2.0:1762166784.445325:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:44804:x1847765440085120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 388us (523us total) trans 4294968928 rc 301/301 00000100:00100000:2.0:1762166784.445332:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2744 00000100:00100000:0.0:1762166784.448242:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.448320:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440085376 00000100:00100000:2.0:1762166784.448337:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440085376 00000100:00100000:2.0:1762166784.448404:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2745 00000100:00100000:2.0:1762166784.448415:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:44804:x1847765440085376:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166784.448465:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166784.448544:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0c1e3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cb3 expref: 32 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166784.448561:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:2.0:1762166784.448566:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166784.448601:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.448614:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.448624:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00000040:00080000:2.0:1762166784.448851:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].24, 456 off54728 00000040:00080000:2.0:1762166784.448897:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].12, 536 off52448 00000004:00080000:2.0:1762166784.448902:0:30829:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945cc6399b40 with version 22 00000004:00080000:1.0:1762166784.448974:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 22 rpc_version 22 00000020:00100000:1.0:1762166784.449004:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166784.449014:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc4530700 x1847765446817920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166784.449047:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446817920:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166784.449111:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166784.449148:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7d136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166784.449225:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446817920 00000100:00100000:0.0:1762166784.449230:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446817920 00000100:00100000:0.0:1762166784.449273:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1762166784.449282:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8087:x1847765446817920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166784.449448:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8087:x1847765446817920:12345-0@lo:1000:osp_up1-0.0 Request processed in 168us (336us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1762166784.449456:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1762166784.449534:0:8087:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967455 gen 2 00000004:00080000:1.0:1762166784.449540:0:8087:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967454 committed transno 4294967455 00000004:00080000:1.0:1762166784.449560:0:8087:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967455 committed transno 4294967455 00000100:00100000:1.0:1762166784.449578:0:8087:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc4530700 x1847765446817920/t4294967456(4294967456) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1520/4320 e 0 to 0 dl 1762166800 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166784.449605:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446817920:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1762166784.449632:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a540508d reply state 000000006a83dd49 transno 4294968929 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.449645:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166784.449650:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:2.0:1762166784.449652:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1762166784.449654:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1762166784.449660:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000100:00100000:2.0:1762166784.449723:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+33:44804:x1847765440085376:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1310us (1494us total) trans 4294968929 rc 0/0 00000100:00100000:2.0:1762166784.449730:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2745 00000100:00100000:1.0:1762166784.451000:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.451043:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440085632 00000100:00100000:2.0:1762166784.451049:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440085632 00000100:00100000:2.0:1762166784.451089:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 790 00000100:00100000:2.0:1762166784.451098:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:44804:x1847765440085632:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166784.451258:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:44804:x1847765440085632:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 161us (261us total) trans 4294968930 rc 0/0 00000100:00100000:2.0:1762166784.451279:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 790 00000100:00100000:0.0:1762166784.462606:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166784.462685:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440085760 00000100:00100000:2.0:1762166784.462697:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440085760 00000100:00100000:2.0:1762166784.462774:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 791 00000100:00100000:2.0:1762166784.462785:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:44807:x1847765440085760:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:2.0:1762166784.462872:0:13556:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1762166784.462878:0:13556:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1762166784.462968:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:44807:x1847765440085760:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 184us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166784.462976:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 791 00010000:00010000:3.0:1762166784.786739:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166785.190775:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166785.190850:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440086016 00000100:00100000:2.0:1762166785.190861:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440086016 00000100:00100000:2.0:1762166785.190922:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2746 00000100:00100000:2.0:1762166785.190934:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:45000:x1847765440086016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166785.190957:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166785.190985:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477800/0x2f180c4effb0c21b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ccf expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166785.191063:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166785.191077:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191090:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191102:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166785.191119:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191125:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191176:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0c230 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166785.191186:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0c230 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191193:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0c230 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191206:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191213:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191219:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191226:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191233:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166785.191237:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191245:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191267:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cf39a3400) 00010000:00010000:2.0:1762166785.191271:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166785.191276:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191283:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0c222 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191297:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191304:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191310:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191316:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166785.191319:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191325:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191333:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x892874e3 (ffff945cf39a3b00) 00010000:00010000:2.0:1762166785.191336:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166785.191339:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191345:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0c229 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166785.191393:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477800/0x2f180c4effb0c21b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ccf expref: 18 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166785.191416:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0c230 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ccf expref: 17 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166785.191424:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cf39a3d00) 00010000:00010000:2.0:1762166785.191426:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166785.191428:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166785.191542:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:45000:x1847765440086016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 610us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166785.191551:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2746 00000100:00100000:1.0:1762166785.193255:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.193330:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166785.193367:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440086400 00000100:00100000:3.0:1762166785.193375:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440086400 00000100:00100000:2.0:1762166785.193416:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440086272 00000100:00100000:2.0:1762166785.193427:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440086272 00000100:00100000:3.0:1762166785.193434:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 285 00000100:00100000:3.0:1762166785.193460:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440086400:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166785.193533:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166785.193550:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2747 00010000:00010000:3.0:1762166785.193556:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0c230 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ccf expref: 17 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.193568:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:45000:x1847765440086272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166785.193573:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cf39a3d00) 00010000:00010000:3.0:1762166785.193578:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166785.193584:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166785.193601:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c237 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cd6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166785.193622:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440086400:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 168us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166785.193630:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 285 00000004:00200000:1.0:1762166785.193733:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:1.0:1762166785.193818:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c237 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cd6 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.193830:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166785.193833:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166785.193838:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c237 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cd6 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.193860:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15e00, rc 0) 00000100:00100000:1.0:1762166785.193905:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:45000:x1847765440086272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 345us (583us total) trans 4294968931 rc 301/301 00000100:00100000:1.0:1762166785.193912:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2747 00000100:00100000:0.0:1762166785.195533:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166785.195577:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440086528 00000100:00100000:2.0:1762166785.195588:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440086528 00000100:00100000:2.0:1762166785.195646:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 792 00000100:00100000:2.0:1762166785.195657:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:45000:x1847765440086528:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:2.0:1762166785.195757:0:13556:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1762166785.195763:0:13556:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1762166785.195845:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:45000:x1847765440086528:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 190us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166785.195855:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 792 00000100:00100000:2.0:1762166785.197330:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166785.197412:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440086784 00000100:00100000:1.0:1762166785.197422:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440086784 00000100:00100000:0.0:1762166785.197516:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 793 00000100:00100000:0.0:1762166785.197528:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:45000:x1847765440086784:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166785.197738:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:45000:x1847765440086784:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 212us (411us total) trans 4294968932 rc 0/0 00000100:00100000:0.0:1762166785.197745:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 793 00000004:00080000:0.0:1762166785.298759:0:9996:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 404447276351ns, next at 405447271299ns, rc = 0 00000100:00100000:3.0:1762166785.298760:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446818176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166785.298761:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446818048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1762166785.298844:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166785.298870:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446818176 00000100:00100000:1.0:1762166785.298878:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446818176 00000100:00100000:0.0:1762166785.298911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166785.298943:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446818048 00000100:00080000:2.0:1762166785.298948:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166785.298950:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446818048 00000100:00100000:1.0:1762166785.298967:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1762166785.298979:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446818176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166785.299019:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1762166785.299025:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1762166785.299035:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446818048:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1762166785.299042:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1762166785.299051:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1762166785.299094:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446818176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166785.299106:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1762166785.299109:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446818048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166785.299121:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1762166785.299152:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446818176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166785.299199:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446818048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166785.810855:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166785.810915:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446818304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166785.811057:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166785.811223:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166785.811283:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446818304 00000100:00100000:2.0:1762166785.811315:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446818304 00000100:00100000:1.0:1762166785.811535:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1762166785.811562:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446818304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1762166785.811640:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445933056 avail 1299693568 00000100:00100000:1.0:1762166785.811730:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446818304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166785.811741:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1762166785.811808:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446818304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166785.925753:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166785.925875:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440087040 00000100:00100000:1.0:1762166785.925890:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440087040 00000100:00100000:1.0:1762166785.925956:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2748 00000100:00100000:1.0:1762166785.925965:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:45191:x1847765440087040:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166785.926041:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166785.926077:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0c1b9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ca5 expref: 36 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.926096:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166785.926099:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166785.926119:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.926130:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.926136:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000040:00080000:1.0:1762166785.926360:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].25, 216 off54944 00000040:00080000:1.0:1762166785.926405:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].13, 296 off52744 00000004:00080000:1.0:1762166785.926413:0:6495:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945ccba916c0 with version 23 00000004:00080000:2.0:1762166785.926506:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 23 rpc_version 23 00000020:00100000:2.0:1762166785.926544:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1762166785.926554:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc5f5ca80 x1847765446818560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1296/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166785.926580:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446818560:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166785.926669:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166785.926719:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446818560 00000100:00100000:1.0:1762166785.926725:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446818560 00000100:00100000:2.0:1762166785.926748:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166785.926773:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1762166785.926787:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8087:x1847765446818560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166785.927006:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8087:x1847765446818560:12345-0@lo:1000:osp_up1-0.0 Request processed in 223us (336us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1762166785.927015:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1762166785.927138:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446818560:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1762166785.927170:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a1e0197a reply state 000000003451f54e transno 4294968933 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.927215:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.927222:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166785.927224:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1762166785.927227:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1762166785.927235:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000100:00100000:1.0:1762166785.927316:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:45191:x1847765440087040:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1350us (1579us total) trans 4294968933 rc 0/0 00000100:00100000:1.0:1762166785.927325:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2748 00000100:00100000:3.0:1762166785.935312:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166785.935375:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440087296 00000100:00100000:1.0:1762166785.935388:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440087296 00000100:00100000:1.0:1762166785.935469:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2749 00000100:00100000:1.0:1762166785.935510:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:45192:x1847765440087296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166785.935537:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166785.935562:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14e00/0x2f180c4effb0c24c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cdd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.935651:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.935666:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935679:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935692:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.935698:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935721:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935784:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0c261 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.935790:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0c261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935794:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0c261 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935805:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935809:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935813:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935818:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935823:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166785.935827:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935833:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935845:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634e00) 00010000:00010000:1.0:1762166785.935849:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166785.935863:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935869:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15200/0x2f180c4effb0c253 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935883:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935887:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935890:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935893:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166785.935895:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935898:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935902:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff945cd4634600) 00010000:00010000:1.0:1762166785.935903:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166785.935905:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935908:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c25a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166785.935956:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14e00/0x2f180c4effb0c24c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cdd expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.935972:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0c261 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cdd expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.935984:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd4634f00) 00010000:00010000:1.0:1762166785.935985:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166785.935987:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14a00, rc 0) 00000100:00100000:1.0:1762166785.936041:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:45192:x1847765440087296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 565us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166785.936047:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2749 00000100:00100000:2.0:1762166785.937321:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166785.937323:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166785.937413:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440087680 00000100:00100000:1.0:1762166785.937418:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440087680 00000100:00100000:3.0:1762166785.937428:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440087552 00000100:00100000:3.0:1762166785.937434:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440087552 00000100:00100000:1.0:1762166785.937473:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 286 00000100:00100000:1.0:1762166785.937509:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440087680:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166785.937515:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2750 00010000:00010000:1.0:1762166785.937524:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166785.937530:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:45192:x1847765440087552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166785.937542:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0c261 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cdd expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.937559:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166785.937563:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd4634f00) 00010000:00010000:1.0:1762166785.937568:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166785.937573:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c268 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ce4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166785.937601:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765440087680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 96us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166785.937610:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 286 00000004:00200000:3.0:1762166785.937690:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1762166785.937832:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c268 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ce4 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.937842:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:3.0:1762166785.937844:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166785.937848:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c268 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ce4 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.937860:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c7a00, rc 0) 00000100:00100000:3.0:1762166785.937903:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:45192:x1847765440087552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 378us (584us total) trans 4294968934 rc 301/301 00000100:00100000:3.0:1762166785.937910:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2750 00000100:00100000:3.0:1762166785.939102:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.939159:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440087936 00000100:00100000:0.0:1762166785.939170:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440087936 00000100:00100000:0.0:1762166785.939210:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 794 00000100:00100000:0.0:1762166785.939220:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:45192:x1847765440087936:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166785.939330:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:45192:x1847765440087936:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 112us (228us total) trans 4294968935 rc 0/0 00000100:00100000:0.0:1762166785.939338:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 794 00000100:00100000:2.0:1762166785.940619:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.940657:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440088064 00000100:00100000:0.0:1762166785.940661:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440088064 00000100:00100000:0.0:1762166785.940687:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 795 00000100:00100000:0.0:1762166785.940693:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:45192:x1847765440088064:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:0.0:1762166785.940743:0:6498:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1762166785.940749:0:6498:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1762166785.940782:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:45192:x1847765440088064:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 89us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.940789:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 795 00000100:00100000:1.0:1762166785.941858:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166785.941906:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440088192 00000100:00100000:3.0:1762166785.941912:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440088192 00000100:00100000:3.0:1762166785.941958:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2751 00000100:00100000:3.0:1762166785.941968:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:45192:x1847765440088192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166785.941992:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166785.942020:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c276 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ceb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.942084:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0c27d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166785.942115:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0c27d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166785.942128:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0c27d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166785.942197:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1762166785.942203:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1762166785.942286:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0c27d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166785.942313:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c276 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ceb expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.942334:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0c27d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ceb expref: 40 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166785.942343:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:3.0:1762166785.942346:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166785.942350:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6600, rc 0) 00000100:00100000:3.0:1762166785.942409:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:45192:x1847765440088192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 443us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166785.942416:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2751 00000100:00100000:3.0:1762166785.944364:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.944442:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440088320 00000100:00100000:0.0:1762166785.944461:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440088320 00000100:00100000:0.0:1762166785.944531:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2752 00000100:00100000:0.0:1762166785.944541:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:45192:x1847765440088320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.944556:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.944575:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0c284 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cf2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.944633:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c28b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.944646:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c28b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.944655:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c28b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166785.944726:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1762166785.944731:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1762166785.944743:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c28b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.944764:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0c284 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cf2 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.944780:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c28b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cf2 expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.944789:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:0.0:1762166785.944792:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166785.944795:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88a00, rc 0) 00000100:00100000:0.0:1762166785.944850:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:45192:x1847765440088320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 311us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.944857:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2752 00000100:00100000:2.0:1762166785.946282:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.946323:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440088576 00000100:00100000:0.0:1762166785.946329:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440088576 00000100:00100000:0.0:1762166785.946363:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2753 00000100:00100000:0.0:1762166785.946383:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:45192:x1847765440088576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.946394:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.946405:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c292 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7cf9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166785.946522:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:0.0:1762166785.946610:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c292 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cf9 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.946623:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:0.0:1762166785.946626:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166785.946630:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c292 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cf9 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.946642:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88200, rc 0) 00000100:00100000:0.0:1762166785.946677:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+42:45192:x1847765440088576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 306us (395us total) trans 4294968936 rc 301/301 00000100:00100000:0.0:1762166785.946684:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2753 00000100:00100000:1.0:1762166785.947874:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.947913:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440088832 00000100:00100000:0.0:1762166785.947917:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440088832 00000100:00100000:0.0:1762166785.947940:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2754 00000100:00100000:0.0:1762166785.947945:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+42:45192:x1847765440088832:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166785.947987:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166785.948001:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c28b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cf2 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.948012:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:0.0:1762166785.948015:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166785.948026:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.948035:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.948042:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000040:00080000:0.0:1762166785.948238:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].26, 216 off55160 00000040:00080000:0.0:1762166785.948275:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].14, 296 off53040 00000004:00080000:0.0:1762166785.948280:0:6495:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc6e62b40 with version 24 00000004:00080000:2.0:1762166785.948320:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 24 rpc_version 24 00000020:00100000:2.0:1762166785.948349:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1762166785.948358:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc5ef4e00 x1847765446818816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1040/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166785.948384:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446818816:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166785.948435:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166785.948501:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446818816 00000100:00100000:1.0:1762166785.948507:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446818816 00000100:00100000:2.0:1762166785.948516:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166785.948547:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:1.0:1762166785.948557:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8087:x1847765446818816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166785.948697:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8087:x1847765446818816:12345-0@lo:1000:osp_up1-0.0 Request processed in 141us (261us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1762166785.948705:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1762166785.948748:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446818816:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1762166785.948774:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001748711a reply state 0000000056288cbf transno 4294968937 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.948788:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.948795:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:0.0:1762166785.948798:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1762166785.948800:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1762166785.948806:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000100:00100000:0.0:1762166785.948854:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:45192:x1847765440088832:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 908us (980us total) trans 4294968937 rc 0/0 00000100:00100000:0.0:1762166785.948862:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2754 00000100:00100000:3.0:1762166785.949778:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.949829:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440089088 00000100:00100000:0.0:1762166785.949835:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440089088 00000100:00100000:0.0:1762166785.949866:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 796 00000100:00100000:0.0:1762166785.949872:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:45192:x1847765440089088:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166785.949976:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:45192:x1847765440089088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 103us (204us total) trans 4294968938 rc 0/0 00000100:00100000:0.0:1762166785.949985:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 796 00000100:00100000:2.0:1762166785.961541:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.961614:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440089216 00000100:00100000:0.0:1762166785.961632:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440089216 00000100:00100000:0.0:1762166785.961704:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 797 00000100:00100000:0.0:1762166785.961717:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:45195:x1847765440089216:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:0.0:1762166785.961816:0:6498:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1762166785.961821:0:6498:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1762166785.961908:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:45195:x1847765440089216:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 194us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.961916:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 797 00000100:00100000:1.0:1762166785.988436:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.988556:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440089472 00000100:00100000:0.0:1762166785.988575:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440089472 00000100:00100000:0.0:1762166785.988674:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2755 00000100:00100000:0.0:1762166785.988690:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:45203:x1847765440089472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166785.988724:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166785.988758:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0c2a7 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d00 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.988882:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.988900:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.988934:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.988952:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.988960:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.988967:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989047:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0c2bc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166785.989057:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0c2bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989065:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0c2bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989081:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989088:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989095:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989102:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989109:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166785.989120:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989130:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989145:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945bc4180900) 00010000:00010000:0.0:1762166785.989149:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166785.989155:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989163:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88200/0x2f180c4effb0c2ae lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989182:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989189:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989195:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989201:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166785.989204:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989210:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989218:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x892874e3 (ffff945bc4180c00) 00010000:00010000:0.0:1762166785.989221:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166785.989224:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989240:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb89e00/0x2f180c4effb0c2b5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166785.989281:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88a00/0x2f180c4effb0c2a7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d00 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.989299:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0c2bc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d00 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.989307:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cf39a3d00) 00010000:00010000:0.0:1762166785.989310:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166785.989313:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88e00, rc 0) 00000100:00100000:0.0:1762166785.989401:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:45203:x1847765440089472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 716us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.989410:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2755 00000100:00100000:3.0:1762166785.990826:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166785.990842:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.990892:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440089856 00000100:00100000:1.0:1762166785.990899:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440089728 00000100:00100000:0.0:1762166785.990900:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440089856 00000100:00100000:1.0:1762166785.990904:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440089728 00000100:00100000:1.0:1762166785.990949:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2756 00000100:00100000:1.0:1762166785.990958:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:45203:x1847765440089728:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166785.990966:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 287 00010000:00010000:1.0:1762166785.990976:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166785.990978:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440089856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166785.990996:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166785.991009:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c2c3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d07 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.991034:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bccb88e00/0x2f180c4effb0c2bc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d00 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166785.991051:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cf39a3d00) 00010000:00010000:0.0:1762166785.991056:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166785.991104:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440089856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.991129:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 287 00000004:00200000:1.0:1762166785.991198:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:1.0:1762166785.991323:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c2c3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d07 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.991332:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166785.991335:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166785.991340:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c2c3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d07 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.991351:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15000, rc 0) 00000100:00100000:1.0:1762166785.991398:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:45203:x1847765440089728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 442us (571us total) trans 4294968939 rc 301/301 00000100:00100000:1.0:1762166785.991405:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2756 00000100:00100000:1.0:1762166785.993276:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.993344:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440089984 00000100:00100000:0.0:1762166785.993357:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440089984 00000100:00100000:0.0:1762166785.993428:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 798 00000100:00100000:0.0:1762166785.993441:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:45203:x1847765440089984:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:0.0:1762166785.993576:0:6498:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1762166785.993581:0:6498:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1762166785.993658:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:45203:x1847765440089984:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 220us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166785.993667:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 798 00000100:00100000:3.0:1762166785.994979:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166785.995052:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440090112 00000100:00100000:1.0:1762166785.995058:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440090112 00000100:00100000:1.0:1762166785.995111:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2757 00000100:00100000:1.0:1762166785.995120:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:45203:x1847765440090112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166785.995132:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166785.995177:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2d1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d0e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.995243:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c2d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.995258:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.995270:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166785.995336:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1762166785.995339:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1762166785.995352:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166785.995376:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2d1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d0e expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.995400:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d0e expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166785.995407:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166785.995409:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166785.995412:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14c00, rc 0) 00000100:00100000:1.0:1762166785.995447:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+46:45203:x1847765440090112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 330us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166785.995464:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2757 00000100:00100000:2.0:1762166785.998887:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166785.998964:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440090368 00000100:00100000:0.0:1762166785.998974:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440090368 00000100:00100000:0.0:1762166785.999033:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 799 00000100:00100000:0.0:1762166785.999049:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+46:45203:x1847765440090368:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166785.999294:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:45203:x1847765440090368:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 250us (418us total) trans 4294968940 rc 0/0 00000100:00100000:0.0:1762166785.999302:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 799 00000100:00100000:0.0:1762166786.017155:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166786.017232:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440090624 00000100:00100000:1.0:1762166786.017247:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440090624 00000100:00080000:2.0:1762166786.017322:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166786.017359:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2758 00000100:00100000:1.0:1762166786.017373:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:45209:x1847765440090624:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166786.017465:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166786.017532:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6600/0x2f180c4effb0c27d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ceb expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.017556:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166786.017562:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166786.017588:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 3/0,1 mode: --/PW res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.017600:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.017609:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000040:00080000:1.0:1762166786.017891:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].27, 616 off55776 00000040:00080000:1.0:1762166786.017951:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].15, 696 off53736 00000004:00080000:1.0:1762166786.017958:0:6495:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc4446e40 with version 25 00000004:00080000:2.0:1762166786.018002:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 25 rpc_version 25 00000020:00100000:2.0:1762166786.018047:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1762166786.018059:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc5588700 x1847765446819072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2096/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166786.018088:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446819072:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166786.018180:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166786.018220:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446819072 00000100:00100000:1.0:1762166786.018225:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446819072 00000100:00100000:2.0:1762166786.018241:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166786.018264:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1762166786.018272:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8087:x1847765446819072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166786.018663:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8087:x1847765446819072:12345-0@lo:1000:osp_up1-0.0 Request processed in 391us (480us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1762166786.018678:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1762166786.018723:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446819072:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1762166786.018743:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007f7e94a1 reply state 000000001d15adfc transno 4294968941 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.018760:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.018766:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166786.018768:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1762166786.018770:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1762166786.018779:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000100:00100000:1.0:1762166786.018852:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+48:45209:x1847765440090624:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1481us (1709us total) trans 4294968941 rc 0/0 00000100:00100000:1.0:1762166786.018860:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2758 00000100:00100000:3.0:1762166786.025991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166786.026065:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440090880 00000100:00100000:1.0:1762166786.026076:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440090880 00000100:00100000:1.0:1762166786.026135:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2759 00000100:00100000:1.0:1762166786.026144:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:45210:x1847765440090880:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:2.0:1762166786.026145:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1762166786.026164:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166786.026183:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c2e6 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d15 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.026243:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.026255:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026262:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026281:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.026286:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026290:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026333:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c2fb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.026337:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c2fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026341:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c2fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026350:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026354:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026358:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026362:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026365:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166786.026368:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026380:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026388:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634e00) 00010000:00010000:1.0:1762166786.026390:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166786.026393:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026397:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15c00/0x2f180c4effb0c2ed lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026406:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026410:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026413:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026416:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166786.026417:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026420:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026424:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x46a4c46c (ffff945cd4634600) 00010000:00010000:1.0:1762166786.026425:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166786.026426:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026429:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c2f4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x46a4c46c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166786.026505:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c2e6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d15 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.026521:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c2fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d15 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.026529:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd4634f00) 00010000:00010000:1.0:1762166786.026531:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166786.026534:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14600, rc 0) 00000100:00100000:1.0:1762166786.026588:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:45210:x1847765440090880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 445us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.026596:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2759 00000100:00100000:2.0:1762166786.027947:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166786.027956:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166786.027998:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440091136 00000100:00100000:1.0:1762166786.028003:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440091136 00000100:00100000:0.0:1762166786.028016:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440091264 00000100:00100000:0.0:1762166786.028022:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440091264 00000100:00100000:1.0:1762166786.028033:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2760 00000100:00100000:1.0:1762166786.028042:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+48:45210:x1847765440091136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166786.028054:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166786.028066:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c302 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d1c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166786.028068:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00100000:0.0:1762166786.028082:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765440091264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166786.028095:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166786.028110:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14600/0x2f180c4effb0c2fb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d15 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166786.028134:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd4634f00) 00010000:00010000:0.0:1762166786.028138:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1762166786.028177:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000100:00100000:0.0:1762166786.028177:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440091264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 97us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.028188:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 288 00010000:00010000:1.0:1762166786.028261:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c302 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d1c expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.028271:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166786.028273:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166786.028277:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c302 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d1c expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.028292:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15400, rc 0) 00000100:00100000:1.0:1762166786.028324:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:45210:x1847765440091136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 284us (405us total) trans 4294968942 rc 301/301 00000100:00100000:1.0:1762166786.028331:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2760 00000100:00100000:3.0:1762166786.029173:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166786.029212:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440091520 00000100:00100000:0.0:1762166786.029215:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440091520 00000100:00100000:0.0:1762166786.029239:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 800 00000100:00100000:0.0:1762166786.029243:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:45210:x1847765440091520:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166786.029324:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:45210:x1847765440091520:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 81us (158us total) trans 4294968943 rc 0/0 00000100:00100000:0.0:1762166786.029329:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 800 00000100:00100000:2.0:1762166786.030260:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166786.030294:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440091648 00000100:00100000:0.0:1762166786.030298:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440091648 00000100:00100000:0.0:1762166786.030322:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 801 00000100:00100000:0.0:1762166786.030327:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:45210:x1847765440091648:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:0.0:1762166786.030358:0:6498:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1762166786.030361:0:6498:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1762166786.030390:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:45210:x1847765440091648:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 63us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.030396:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 801 00000100:00100000:2.0:1762166786.030994:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166786.031019:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440091776 00000100:00100000:1.0:1762166786.031024:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440091776 00000100:00100000:1.0:1762166786.031056:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2761 00000100:00100000:1.0:1762166786.031064:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:45210:x1847765440091776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166786.031072:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166786.031083:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c310 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d23 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.031115:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15800/0x2f180c4effb0c317 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.031126:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15800/0x2f180c4effb0c317 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.031134:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15800/0x2f180c4effb0c317 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166786.031169:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1762166786.031173:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1762166786.031182:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15800/0x2f180c4effb0c317 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.031199:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c310 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d23 expref: 52 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.031222:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15800/0x2f180c4effb0c317 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d23 expref: 51 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.031226:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:1.0:1762166786.031228:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166786.031230:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15800, rc 0) 00000100:00100000:1.0:1762166786.031254:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+51:45210:x1847765440091776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 192us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166786.031259:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2761 00000100:00100000:0.0:1762166786.032853:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166786.032884:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440092032 00000100:00100000:1.0:1762166786.032888:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440092032 00000100:00100000:1.0:1762166786.032911:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2762 00000100:00100000:1.0:1762166786.032916:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+51:45210:x1847765440092032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166786.032923:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166786.032929:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c31e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d2a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.032983:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15c00/0x2f180c4effb0c325 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.032989:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15c00/0x2f180c4effb0c325 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.032993:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15c00/0x2f180c4effb0c325 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166786.032998:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:1.0:1762166786.033034:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c31e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d2a expref: 54 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.033052:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15c00/0x2f180c4effb0c325 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d2a expref: 53 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.033059:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166786.033062:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166786.033065:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15c00, rc 0) 00000100:00100000:1.0:1762166786.033095:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+53:45210:x1847765440092032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 179us (243us total) trans 4294968944 rc 0/0 00000100:00100000:1.0:1762166786.033100:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2762 00000100:00100000:2.0:1762166786.034031:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166786.034072:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440092288 00000100:00100000:1.0:1762166786.034077:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440092288 00000100:00100000:1.0:1762166786.034105:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2763 00000100:00100000:1.0:1762166786.034112:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+53:45210:x1847765440092288:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166786.034137:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166786.034148:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c2d8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d0e expref: 53 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166786.034159:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166786.034162:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166786.034171:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.034176:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.034181:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000040:00080000:1.0:1762166786.034342:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].28, 616 off56392 00000040:00080000:1.0:1762166786.034378:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].16, 696 off54432 00000004:00080000:1.0:1762166786.034383:0:6495:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945ccac36b40 with version 26 00000004:00080000:2.0:1762166786.034419:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 26 rpc_version 26 00000020:00100000:2.0:1762166786.034443:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1762166786.034463:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc558aa00 x1847765446819328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1840/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166786.034501:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446819328:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166786.034538:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166786.034568:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446819328 00000100:00100000:1.0:1762166786.034573:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446819328 00000100:00100000:2.0:1762166786.034576:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166786.034608:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1762166786.034615:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8087:x1847765446819328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166786.034751:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:8087:x1847765446819328:12345-0@lo:1000:osp_up1-0.0 Request processed in 136us (211us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1762166786.034759:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1762166786.034811:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446819328:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1762166786.034822:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009d91795d reply state 0000000090f22975 transno 4294968945 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.034835:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166786.034842:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166786.034844:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1762166786.034847:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1762166786.034852:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000100:00100000:1.0:1762166786.034890:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:45210:x1847765440092288:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 778us (858us total) trans 4294968945 rc 0/0 00000100:00100000:1.0:1762166786.034897:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2763 00000100:00100000:2.0:1762166786.045344:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166786.045432:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440092416 00000100:00100000:0.0:1762166786.045457:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440092416 00000100:00100000:0.0:1762166786.045552:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 802 00000100:00100000:0.0:1762166786.045582:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:45213:x1847765440092416:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:0.0:1762166786.045698:0:6498:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1762166786.045704:0:6498:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1762166786.045807:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:45213:x1847765440092416:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 226us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166786.045815:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 802 00000100:00100000:1.0:1762166786.322816:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446819456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166786.322916:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166786.322984:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446819456 00000100:00100000:2.0:1762166786.323001:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446819456 00000100:00100000:2.0:1762166786.323076:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1762166786.323090:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:3635:x1847765446819456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1762166786.323168:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446199296 avail 1299959808 00000100:00100000:2.0:1762166786.323234:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:3635:x1847765446819456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166786.323244:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1762166786.323293:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446819456:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1762166786.834700:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166787.131657:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166787.131735:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440092672 00000100:00100000:1.0:1762166787.131754:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440092672 00000100:00100000:1.0:1762166787.131811:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2764 00000100:00100000:1.0:1762166787.131824:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:45516:x1847765440092672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166787.131848:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166787.131870:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14c00/0x2f180c4effb0c33a lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d31 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166787.131938:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166787.131954:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.131966:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.131995:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166787.132004:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132011:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132067:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15400/0x2f180c4effb0c34f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166787.132076:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15400/0x2f180c4effb0c34f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132082:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15400/0x2f180c4effb0c34f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132111:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132117:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132123:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132129:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132134:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166787.132138:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132146:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132157:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffff945cd4634a00) 00010000:00010000:1.0:1762166787.132160:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166787.132164:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132170:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c341 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132184:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132190:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132195:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132206:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166787.132209:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132215:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132224:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x892874e3 (ffff945cd4634e00) 00010000:00010000:1.0:1762166787.132226:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166787.132229:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132235:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14400/0x2f180c4effb0c348 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x8:0x0].0x892874e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166787.132271:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14c00/0x2f180c4effb0c33a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d31 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166787.132288:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15400/0x2f180c4effb0c34f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d31 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166787.132296:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cf39a3d00) 00010000:00010000:1.0:1762166787.132298:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166787.132301:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15400, rc 0) 00000100:00100000:1.0:1762166787.132366:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:45516:x1847765440092672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 545us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166787.132374:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2764 00000100:00100000:2.0:1762166787.133551:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166787.133567:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166787.133586:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440092928 00000100:00100000:1.0:1762166787.133593:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440092928 00000100:00100000:3.0:1762166787.133613:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440093056 00000100:00100000:3.0:1762166787.133619:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440093056 00000100:00100000:1.0:1762166787.133638:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2765 00000100:00100000:1.0:1762166787.133648:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:45516:x1847765440092928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166787.133659:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166787.133667:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 289 00010000:00010000:1.0:1762166787.133672:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c356 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d38 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166787.133681:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440093056:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166787.133693:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166787.133706:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f15400/0x2f180c4effb0c34f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d31 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166787.133719:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cf39a3d00) 00010000:00010000:3.0:1762166787.133723:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166787.133756:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440093056:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 81us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166787.133763:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 289 00000004:00200000:1.0:1762166787.133788:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00010000:00010000:1.0:1762166787.133876:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c356 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d38 expref: 56 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166787.133886:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166787.133889:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166787.133892:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c356 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d38 expref: 56 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166787.133902:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15000, rc 0) 00000100:00100000:1.0:1762166787.133933:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+55:45516:x1847765440092928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 287us (385us total) trans 4294968946 rc 301/301 00000100:00100000:1.0:1762166787.133941:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2765 00000100:00100000:0.0:1762166787.134859:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166787.134911:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440093312 00000100:00100000:2.0:1762166787.134916:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440093312 00000100:00100000:2.0:1762166787.134948:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 803 00000100:00100000:2.0:1762166787.134956:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+55:45516:x1847765440093312:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166787.135068:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:45516:x1847765440093312:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 112us (210us total) trans 4294968947 rc 0/0 00000100:00100000:2.0:1762166787.135075:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 803 00000100:00100000:2.0:1762166787.135968:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166787.136010:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440093440 00000100:00100000:0.0:1762166787.136015:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440093440 00000100:00100000:0.0:1762166787.136039:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 804 00000100:00100000:0.0:1762166787.136044:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:45516:x1847765440093440:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:0.0:1762166787.136079:0:6498:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1762166787.136083:0:6498:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1762166787.136113:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:45516:x1847765440093440:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 68us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166787.136117:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 804 00000100:00100000:0.0:1762166787.858654:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762166787.858677:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446819712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166787.858678:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446819584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166787.858784:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166787.858794:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166787.858839:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446819584 00000100:00100000:2.0:1762166787.858850:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446819584 00000100:00100000:0.0:1762166787.858874:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446819712 00000100:00100000:0.0:1762166787.858879:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446819712 00000100:00080000:3.0:1762166787.858893:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166787.858931:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1762166787.858938:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1762166787.858950:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf407f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446819584:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166787.858952:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446819712:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1762166787.858966:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:0.0:1762166787.858985:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 17096384 pending 0 free 3922427904 avail 3690905600 00002000:00000024:2.0:1762166787.858986:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 17096384 pending 0 free 3922427904 avail 3690905600 00000100:00100000:2.0:1762166787.859040:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf407f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446819584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166787.859045:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446819712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166787.859056:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1762166787.859063:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1762166787.859122:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446819712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166787.859142:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446819584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166788.882697:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166788.882726:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446820224:0@lo:400:kworker.0 00010000:00010000:2.0:1762166788.882737:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166788.882768:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446820352:0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.882791:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446820096:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.882805:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166788.882819:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166788.882849:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166788.882879:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446819840:0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.882880:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446820608:0@lo:400:kworker.0 00000100:00100000:2.0:1762166788.882882:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446820864:0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.882923:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166788.882938:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446820352 00000100:00100000:1.0:1762166788.882943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166788.882947:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446820352 00000100:00100000:3.0:1762166788.882953:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1847765446821120:0@lo:400:kworker.0 00000100:00100000:0.0:1762166788.882983:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1847765446819968:0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.882984:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166788.882991:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446820736:0@lo:400:kworker.0 00000100:00100000:2.0:1762166788.882996:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446820096 00000100:00100000:2.0:1762166788.883000:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446820096 00000100:00100000:0.0:1762166788.883023:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166788.883027:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1762166788.883033:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166788.883041:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765446820352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.883048:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1762166788.883048:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446820480:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883060:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1847765446821248:0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.883063:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446820096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166788.883080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166788.883097:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166788.883106:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1847765446820992:0@lo:400:kworker.0 00000100:00100000:2.0:1762166788.883127:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765446820352:12345-0@lo:400:kworker.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166788.883130:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166788.883134:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446820096:12345-0@lo:400:kworker.0 Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166788.883139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166788.883143:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446821376:0@lo:400:kworker.0 00000100:00100000:2.0:1762166788.883144:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1762166788.883159:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1762166788.883177:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446820224 00000100:00100000:1.0:1762166788.883178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166788.883183:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446821120 00000100:00100000:0.0:1762166788.883183:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446820224 00000100:00100000:2.0:1762166788.883190:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446821120 00000100:00100000:3.0:1762166788.883191:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446820608 00000100:00100000:3.0:1762166788.883197:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446820608 00000100:00100000:0.0:1762166788.883213:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446819968 00000100:00100000:0.0:1762166788.883216:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446819968 00000100:00100000:1.0:1762166788.883221:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446821248 00000100:00100000:1.0:1762166788.883226:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446821248 00000100:00100000:3.0:1762166788.883230:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446820736 00000100:00100000:2.0:1762166788.883233:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446820992 00000100:00100000:3.0:1762166788.883235:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446820736 00000100:00100000:0.0:1762166788.883237:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446821376 00000100:00100000:2.0:1762166788.883240:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446820992 00000100:00100000:0.0:1762166788.883241:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446821376 00000100:00100000:1.0:1762166788.883257:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1762166788.883265:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446820480 00000100:00100000:3.0:1762166788.883270:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446820480 00000100:00100000:1.0:1762166788.883270:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446820224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166788.883278:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1762166788.883287:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1847765446821120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.883294:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1762166788.883301:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446820608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883317:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446820224:12345-0@lo:400:kworker.0 Request processed in 51us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166788.883325:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1762166788.883331:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446820608:12345-0@lo:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166788.883331:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1847765446821120:12345-0@lo:400:kworker.0 Request processed in 44us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166788.883340:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1762166788.883340:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1762166788.883346:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1762166788.883356:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1847765446819968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.883360:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1762166788.883360:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1762166788.883372:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446820736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166788.883372:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1847765446821248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166788.883438:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1762166788.883446:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1847765446819968:12345-0@lo:400:kworker.0 Request processed in 92us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166788.883455:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446821376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883458:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1762166788.883459:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446820736:12345-0@lo:400:kworker.0 Request processed in 87us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166788.883460:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1847765446821248:12345-0@lo:400:kworker.0 Request processed in 87us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166788.883471:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1762166788.883471:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1762166788.883506:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1762166788.883513:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1762166788.883519:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1847765446820992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.883526:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446820480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166788.883546:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446821376:12345-0@lo:400:kworker.0 Request processed in 99us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166788.883555:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1762166788.883573:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1847765446820992:12345-0@lo:400:kworker.0 Request processed in 57us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166788.883575:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446820480:12345-0@lo:400:kworker.0 Request processed in 52us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166788.883590:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:2.0:1762166788.883593:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166788.883594:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00080000:2.0:1762166788.883600:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1762166788.883606:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166788.883622:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166788.883633:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446819840 00000100:00100000:1.0:1762166788.883638:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446819840 00000100:00100000:3.0:1762166788.883639:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446820864 00000100:00100000:3.0:1762166788.883645:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446820864 00000100:00100000:0.0:1762166788.883653:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1847765446819968:0@lo:400:kworker.0 00000100:00100000:2.0:1762166788.883666:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446820352:0@lo:400:kworker.0 00000100:00100000:0.0:1762166788.883674:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446820480:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883678:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1762166788.883686:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1762166788.883693:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765446819840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166788.883694:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1847765446820992:0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.883695:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446820864:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1762166788.883715:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166788.883745:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446820096:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883748:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765446819840:12345-0@lo:400:kworker.0 Request processed in 59us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166788.883755:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446820864:12345-0@lo:400:kworker.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166788.883763:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1762166788.883767:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1762166788.883771:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446820608:0@lo:400:kworker.0 00000100:00100000:2.0:1762166788.883789:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1847765446821120:0@lo:400:kworker.0 00000100:00100000:3.0:1762166788.883808:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446820864:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883832:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446821376:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883845:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446820736:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883859:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1847765446821248:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883869:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446820224:0@lo:400:kworker.0 00000100:00100000:1.0:1762166788.883876:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446819840:0@lo:400:kworker.0 00000001:00080000:0.0:1762166788.885081:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968947 is committed 00000020:00080000:0.0:1762166788.885129:0:6475:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc4076600 refcount 2 committed 0 result 0 batchid 46 00000020:00080000:0.0:1762166788.885134:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37be700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4076900 00000020:00080000:0.0:1762166788.885137:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].11 00000020:00080000:0.0:1762166788.885139:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37be300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc71aee00 00000020:00080000:0.0:1762166788.885141:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].23 00000020:00080000:0.0:1762166788.885162:0:6475:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc4446300 refcount 2 committed 0 result 0 batchid 45 00000020:00080000:0.0:1762166788.885166:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37bee00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4446e40 00000020:00080000:0.0:1762166788.885168:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].10 00000020:00080000:0.0:1762166788.885171:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37be900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc71afa00 00000020:00080000:0.0:1762166788.885173:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].22 00000020:00080000:0.0:1762166788.885179:0:6475:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc10de480 refcount 2 committed 0 result 0 batchid 44 00000020:00080000:0.0:1762166788.885183:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1f8f900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc10de000 00000020:00080000:0.0:1762166788.885185:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].9 00000020:00080000:0.0:1762166788.885187:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1f8f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc7070e00 00000020:00080000:0.0:1762166788.885190:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].21 00000020:00080000:0.0:1762166788.885195:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 43 batchid updated 00010000:00010000:2.0:1762166788.885260:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885272:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885278:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885291:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885295:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885302:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885317:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:2.0:1762166788.885320:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166788.885325:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885330:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c07e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885342:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885347:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885351:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885356:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885358:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885363:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885370:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x9:0x0].0x0 (ffff945bc4077100) 00010000:00010000:2.0:1762166788.885372:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166788.885381:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885386:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c085 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885408:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885414:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885419:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885424:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885426:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885431:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885438:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:2.0:1762166788.885440:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166788.885443:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885448:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0c0fc lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885458:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885464:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885519:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885524:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885526:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885533:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885542:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:2.0:1762166788.885544:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166788.885547:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885552:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c157 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885563:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885568:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885573:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885578:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885580:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885585:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885604:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xa:0x0].0x0 (ffff945cd4634b00) 00010000:00010000:2.0:1762166788.885607:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166788.885610:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885616:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0c15e lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885627:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885633:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885638:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885643:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885645:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885650:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885657:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:2.0:1762166788.885659:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166788.885661:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166788.885666:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c214 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT0 00000020:00080000:1.0:1762166788.885666:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 46 committed batchid 43 00010000:00010000:2.0:1762166788.885676:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885686:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885691:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885696:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885698:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885703:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885710:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:2.0:1762166788.885712:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166788.885714:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885718:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c245 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885727:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885732:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885737:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885741:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885743:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885756:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885763:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:2.0:1762166788.885765:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166788.885768:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885772:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c2a0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00080000:1.0:1762166788.885778:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945cf1fe20c0 with version 27 00010000:00010000:2.0:1762166788.885781:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885787:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885792:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885797:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15200 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:1.0:1762166788.885798:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 43 cancel update log [0x240000401:0x3:0x0].8: rc = 0 00010000:00010000:2.0:1762166788.885800:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885805:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885811:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945bc4077200) 00010000:00010000:2.0:1762166788.885813:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166788.885816:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885821:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c2df lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166788.885834:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 43 cancel update log [0x200000400:0x2:0x0].20: rc = 0 00010000:00010000:2.0:1762166788.885836:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166788.885840:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 43 00010000:00010000:2.0:1762166788.885842:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885847:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885852:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166788.885855:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885860:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885868:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd4634800) 00010000:00010000:2.0:1762166788.885870:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166788.885873:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166788.885878:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c333 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000004:00080000:3.0:1762166788.885891:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 27 rpc_version 27 00000020:00100000:3.0:1762166788.885916:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1762166788.885924:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc2d5e680 x1847765446821632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166788.885944:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446821632:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166788.885979:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166788.886002:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166788.886017:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446821632 00000100:00100000:0.0:1762166788.886022:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446821632 00000100:00100000:0.0:1762166788.886054:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1762166788.886062:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:8087:x1847765446821632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166788.886170:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:8087:x1847765446821632:12345-0@lo:1000:osp_up1-0.0 Request processed in 108us (190us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1762166788.886177:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1762166788.886208:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446821632:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166789.389156:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166789.389217:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166789.389239:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440093696 00000100:00100000:1.0:1762166789.389252:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440093696 00000100:00100000:0.0:1762166789.389263:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166789.389301:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166789.389328:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440093824 00000100:00100000:1.0:1762166789.389334:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440093824 00000100:00100000:0.0:1762166789.389351:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166789.389352:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440093568 00000100:00100000:2.0:1762166789.389360:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440093568 00000100:00100000:3.0:1762166789.389368:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 414 00000100:00100000:1.0:1762166789.389414:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 415 00000100:00100000:3.0:1762166789.389424:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765440093696:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166789.389432:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 604 00000100:00100000:1.0:1762166789.389440:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765440093824:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166789.389448:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440093952 00000100:00100000:0.0:1762166789.389454:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440093952 00000100:00100000:2.0:1762166789.389455:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765440093568:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166789.389543:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440094080 00000100:00100000:0.0:1762166789.389547:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440094080 00000100:00100000:0.0:1762166789.389575:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 253 00000100:00100000:0.0:1762166789.389587:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:2416:x1847765440093952:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166789.389601:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765440093568:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 152us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166789.389603:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765440093824:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 172us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166789.389616:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765440093696:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 229us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166789.389633:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 604 00000100:00100000:0.0:1762166789.389640:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:2416:x1847765440093952:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 48us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166789.389655:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 414 00000100:00100000:0.0:1762166789.389674:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 253 00000100:00100000:1.0:1762166789.389675:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 415 00000100:00080000:2.0:1762166789.389696:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1762166789.389702:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1762166789.389711:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1762166789.389719:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166789.389727:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 254 00000100:00100000:3.0:1762166789.389743:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+7:2417:x1847765440094080:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166789.389795:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+7:2417:x1847765440094080:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 58us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166789.389803:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 254 00010000:00010000:3.0:1762166789.906938:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762166789.907706:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836676 is committed 00000001:00080000:0.0:1762166789.907759:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967461 is committed 00000001:00080000:2.0:1762166789.907765:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869359 is committed 00000004:00080000:0.0:1762166789.907771:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 12 committed 00000100:00100000:0.0:1762166789.907863:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446821760:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1762166789.907915:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166789.907962:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446821760 00000100:00100000:3.0:1762166789.907975:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446821760 00000100:00100000:3.0:1762166789.908024:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1762166789.908034:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446821760:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1762166789.908057:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:27 count 1 00010000:00010000:3.0:1762166789.908080:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.908100:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 6 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166789.908108:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166789.908110:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166789.908114:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.908136:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 6 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166789.908146:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 6 pid: 28874 timeout: 509 lvb_type: 1 00000100:00100000:3.0:1762166789.908154:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446821888:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166789.908210:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166789.909776:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446821888:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166789.909798:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166789.910007:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166789.910059:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440094208 00000100:00100000:3.0:1762166789.910072:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440094208 00010000:00010000:3.0:1762166789.910092:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 7 pid: 28874 timeout: 509 lvb_type: 1 00000100:00100000:3.0:1762166789.910122:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 648 00000100:00100000:3.0:1762166789.910128:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+7:2419:x1847765440094208:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166789.910182:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166789.910188:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 7 pid: 28874 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1762166789.910200:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 7 pid: 28874 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1762166789.910221:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effb0bf12 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bfd expref: 7 pid: 28874 timeout: 509 lvb_type: 1 00010000:00010000:3.0:1762166789.910236:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166789.910238:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166789.910241:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.910250:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166789.910279:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166789.910313:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.910324:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166789.910327:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+6:2419:x1847765440094208:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 196us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166789.910355:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 648 00010000:00010000:0.0:1762166789.910358:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.910371:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166789.910410:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166789.910614:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166789.910623:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166789.910633:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166789.910638:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166789.910652:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166789.910665:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446821760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2631us (2745us total) trans 17179869360 rc 0/0 00010000:00010000:2.0:1762166789.910666:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166789.910681:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00010000:00010000:2.0:1762166789.910682:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c364 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166789.910703:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166789.910705:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166789.910707:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166789.910708:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869359 gen 2 00000004:00080000:1.0:1762166789.910715:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e8e00, transno 17179869359 00000100:00100000:1.0:1762166789.910733:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc494d180 x1847765446821760/t17179869360(17179869360) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166805 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166789.910744:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc494d180/2, rc 0, transno 17179869360 00000100:00100000:1.0:1762166789.910750:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446821760:0@lo:6:osp-syn-1-1.0 00000001:02000400:2.0:1762166790.373768:0:31209:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 47: Verify mirror obj alloc =========== 05:46:30 (1762166790) 00000100:00100000:0.0:1762166790.418619:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446822144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1762166790.418626:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446822016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166790.418691:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166790.418751:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166790.418753:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446822016 00000100:00100000:3.0:1762166790.418763:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446822016 00000100:00100000:2.0:1762166790.418800:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446822144 00000100:00100000:2.0:1762166790.418806:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446822144 00000100:00080000:0.0:1762166790.418812:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166790.418831:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1762166790.418845:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446822016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166790.418846:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1762166790.418861:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446822144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1762166790.418881:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00002000:00000024:2.0:1762166790.418881:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1762166790.418945:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446822144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166790.418950:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446822016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166790.418960:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1762166790.418972:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1762166790.418982:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446822144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1762166790.419016:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446822016:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1762166790.918511:0:31257:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_47 needs >= 3 OSTs 00010000:00010000:3.0:1762166790.931645:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166790.931645:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166790.931669:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446822272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166790.931737:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166790.931777:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446822272 00000100:00100000:3.0:1762166790.931787:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446822272 00000100:00100000:3.0:1762166790.931841:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1762166790.931852:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446822272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1762166790.931891:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445933056 avail 1299693568 00000100:00100000:3.0:1762166790.931960:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765446822272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166790.931968:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1762166790.932004:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446822272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166791.442611:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446822400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166791.442684:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166791.442736:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446822400 00000100:00100000:3.0:1762166791.442748:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446822400 00000100:00100000:3.0:1762166791.442808:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1762166791.442819:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446822400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1762166791.442858:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446199296 avail 1299959808 00000100:00100000:3.0:1762166791.442915:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446822400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.442923:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1762166791.443002:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967461 gen 2 00000004:00080000:1.0:1762166791.443008:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967456 committed transno 4294967461 00000020:00080000:1.0:1762166791.443014:0:3635:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc63999c0 refcount 2 committed 0 result 0 batchid 47 00000020:00080000:1.0:1762166791.443018:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc6399b40 00000020:00080000:1.0:1762166791.443021:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].12 00000020:00080000:1.0:1762166791.443024:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf7906e00 00000020:00080000:1.0:1762166791.443026:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].24 00000020:00080000:0.0:1762166791.443055:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 47 committed batchid 43 00000004:00080000:1.0:1762166791.443056:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967457 committed transno 4294967461 00000020:00080000:1.0:1762166791.443062:0:3635:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc7d136c0 refcount 2 committed 0 result 0 batchid 48 00000020:00080000:1.0:1762166791.443066:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37bec00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccba916c0 00000020:00080000:1.0:1762166791.443069:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].13 00000020:00080000:1.0:1762166791.443071:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37bea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc71af800 00000020:00080000:1.0:1762166791.443074:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].25 00000004:00080000:1.0:1762166791.443087:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967458 committed transno 4294967461 00000020:00080000:1.0:1762166791.443097:0:3635:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc6e620c0 refcount 2 committed 0 result 0 batchid 49 00000020:00080000:1.0:1762166791.443100:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccc6bf00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc6e62b40 00000020:00080000:1.0:1762166791.443102:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].14 00000020:00080000:1.0:1762166791.443105:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccc6ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cc34de200 00000020:00080000:1.0:1762166791.443107:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].26 00000020:00080000:0.0:1762166791.443109:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 48 committed batchid 43 00000004:00080000:1.0:1762166791.443120:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967459 committed transno 4294967461 00000020:00080000:0.0:1762166791.443121:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 49 committed batchid 43 00000020:00080000:1.0:1762166791.443127:0:3635:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cce521cc0 refcount 2 committed 0 result 0 batchid 50 00000020:00080000:0.0:1762166791.443130:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 43 00000020:00080000:1.0:1762166791.443131:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37be000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4446e40 00000020:00080000:1.0:1762166791.443137:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].15 00000020:00080000:1.0:1762166791.443139:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37be600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc71ae800 00000020:00080000:1.0:1762166791.443142:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].27 00000020:00080000:0.0:1762166791.443155:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 50 committed batchid 43 00000004:00080000:1.0:1762166791.443160:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967460 committed transno 4294967461 00000020:00080000:1.0:1762166791.443164:0:3635:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc6e62f00 refcount 2 committed 0 result 0 batchid 51 00000020:00080000:0.0:1762166791.443166:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 43 00000020:00080000:1.0:1762166791.443168:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc9241400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccac36b40 00000020:00080000:1.0:1762166791.443172:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].16 00000020:00080000:1.0:1762166791.443175:0:3635:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc37bef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc5bdaa00 00000020:00080000:1.0:1762166791.443178:0:3635:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].28 00000020:00080000:0.0:1762166791.443189:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 51 committed batchid 43 00000004:00080000:1.0:1762166791.443194:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967461 committed transno 4294967461 00000020:00080000:0.0:1762166791.443204:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 43 00000100:00100000:1.0:1762166791.443217:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446822400:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1762166791.541653:0:31305:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 48: Verify snapshot mirror ============ 05:46:31 (1762166791) 00000100:00100000:0.0:1762166791.575867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.575921:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440094336 00000100:00100000:2.0:1762166791.575932:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440094336 00000100:00080000:0.0:1762166791.575981:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166791.576002:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2766 00000100:00100000:2.0:1762166791.576014:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:46688:x1847765440094336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166791.576035:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166791.576068:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0c36b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.576139:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576155:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576169:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576184:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576201:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576225:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576275:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576293:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576298:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576309:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576315:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166791.576319:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576326:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576338:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166791.576341:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166791.576357:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576364:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0c372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576375:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576381:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576392:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576397:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166791.576399:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576405:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576413:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757300) 00010000:00010000:2.0:1762166791.576416:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166791.576419:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576424:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0c379 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.576456:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0c36b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d3f expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.576465:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166791.576468:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166791.576472:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0c36b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d3f expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.576502:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477000, rc 0) 00000100:00100000:2.0:1762166791.576565:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:46688:x1847765440094336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 553us (709us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166791.576573:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2766 00000100:00100000:0.0:1762166791.579082:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.579134:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440094592 00000100:00100000:2.0:1762166791.579143:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440094592 00000100:00100000:2.0:1762166791.579199:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2767 00000100:00100000:2.0:1762166791.579210:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:46688:x1847765440094592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166791.579229:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166791.579232:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166791.579258:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0bb68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7af3 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.579277:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166791.579282:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166791.579294:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0c380 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d46 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.579397:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579414:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579425:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579439:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579447:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579455:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579885:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579895:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579903:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166791.579912:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 0 00010000:00010000:2.0:1762166791.579940:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579948:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579955:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579961:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579967:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166791.579971:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579978:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.579986:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166791.579989:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166791.579992:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.580008:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c387 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:2.0:1762166791.580020:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007f362f11 reply state 00000000ee29f5e1 transno 4294968948 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.580031:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.580038:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757b00) 00010000:00010000:2.0:1762166791.580041:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166791.580043:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166791.580068:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0c380 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.580081:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.580089:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc4757d00) 00010000:00010000:2.0:1762166791.580092:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166791.580094:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166791.580150:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:46688:x1847765440094592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 943us (1075us total) trans 4294968948 rc 0/0 00000100:00100000:2.0:1762166791.580155:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2767 00000100:00100000:0.0:1762166791.581534:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.581635:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440094848 00000100:00100000:2.0:1762166791.581643:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440094848 00000100:00100000:2.0:1762166791.581683:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2768 00000100:00100000:2.0:1762166791.581693:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:46688:x1847765440094848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166791.581714:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166791.581733:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0c3a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d4d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.581812:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.581825:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.581834:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 4/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.581870:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.581887:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 23 pid: 6496 timeout: 510 lvb_type: 0 00000100:00100000:2.0:1762166791.581902:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446822528:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166791.582004:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166791.582849:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446822528:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166791.582869:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166791.582899:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.582987:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440094976 00000100:00100000:3.0:1762166791.582993:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440094976 00010000:00010000:3.0:1762166791.583019:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 24 pid: 6496 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1762166791.583057:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 649 00000100:00100000:3.0:1762166791.583066:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440094976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166791.583076:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166791.583082:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 24 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.583095:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 24 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.583114:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0c395 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d46 expref: 24 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.583128:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc4757d00) 00010000:00010000:3.0:1762166791.583132:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.583140:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.583146:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.583173:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166791.583198:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.583208:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166791.583209:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440094976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 143us (309us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166791.583229:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 0 00000100:00100000:3.0:1762166791.583236:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 649 00000004:00080000:2.0:1762166791.583424:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4b:0x0], index 0: 0 00000004:00080000:2.0:1762166791.583432:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x45:0x0], index 1: 0 00010000:00010000:2.0:1762166791.583566:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.583575:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.583581:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.583588:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166791.583592:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.583600:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.583612:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc4757d00) 00010000:00010000:2.0:1762166791.583615:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166791.583618:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 2/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.583622:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3aa lrc: 0/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.583657:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0c3a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d4d expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.583663:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166791.583665:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166791.583668:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0c3a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d4d expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.583687:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477800, rc 0) 00000100:00100000:2.0:1762166791.583721:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:46688:x1847765440094848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2031us (2192us total) trans 4294968949 rc 301/301 00000100:00100000:2.0:1762166791.583726:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2768 00000100:00100000:2.0:1762166791.585303:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.585377:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440095232 00000100:00100000:1.0:1762166791.585388:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440095232 00000100:00100000:1.0:1762166791.585436:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 805 00000100:00100000:1.0:1762166791.585447:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:46688:x1847765440095232:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166791.585735:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:46688:x1847765440095232:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 289us (434us total) trans 4294968950 rc 0/0 00000100:00100000:1.0:1762166791.585756:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 805 00000100:00100000:3.0:1762166791.588753:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.588833:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440095488 00000100:00100000:1.0:1762166791.588843:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440095488 00000100:00100000:1.0:1762166791.588895:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 806 00000100:00100000:1.0:1762166791.588907:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:46688:x1847765440095488:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166791.589083:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:46688:x1847765440095488:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 178us (332us total) trans 4294968951 rc 0/0 00000100:00100000:1.0:1762166791.589091:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 806 00000100:00100000:1.0:1762166791.596062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.597574:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440095616 00000100:00100000:0.0:1762166791.597584:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440095616 00000100:00100000:0.0:1762166791.597642:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2769 00000100:00100000:0.0:1762166791.597653:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:46693:x1847765440095616:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166791.597676:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.597694:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d54 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.597753:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88000/0x2f180c4effb0c3bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.597767:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88000/0x2f180c4effb0c3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.597779:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88000/0x2f180c4effb0c3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166791.597825:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166791.597829:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166791.597847:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88000/0x2f180c4effb0c3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.597870:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d54 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.597896:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88000/0x2f180c4effb0c3bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d54 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.597905:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166791.597908:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166791.597912:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88000, rc 0) 00000100:00100000:0.0:1762166791.597970:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:46693:x1847765440095616:12345-192.168.204.38@tcp:101:dd.0 Request processed in 319us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.597978:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2769 00000100:00100000:2.0:1762166791.599883:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.599932:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440095872 00000100:00100000:0.0:1762166791.599940:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440095872 00000100:00100000:0.0:1762166791.599983:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2770 00000100:00100000:0.0:1762166791.599993:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:46693:x1847765440095872:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166791.600009:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.600012:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166791.600031:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88000/0x2f180c4effb0c3bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d54 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.600047:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166791.600051:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.600061:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c3c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d5b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.600172:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600183:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600199:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600212:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600219:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600227:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600281:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c3db lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600289:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c3db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600296:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c3db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166791.600304:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 0 00010000:00010000:0.0:1762166791.600405:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600413:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600420:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600427:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600432:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.600443:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600450:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600460:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166791.600463:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166791.600467:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600473:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c3cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600506:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600512:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600519:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600524:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.600527:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600533:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600539:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757b00) 00010000:00010000:0.0:1762166791.600542:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166791.600545:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600559:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c3d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.600590:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c3c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d5b expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.600603:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c3db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d5b expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.600610:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.600613:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166791.600616:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89000, rc 0) 00000100:00100000:0.0:1762166791.600665:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:46693:x1847765440095872:12345-192.168.204.38@tcp:101:dd.0 Request processed in 674us (786us total) trans 4294968952 rc 0/0 00000100:00100000:0.0:1762166791.600673:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2770 00000100:00100000:0.0:1762166791.602097:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.602143:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440096000 00000100:00100000:2.0:1762166791.602150:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440096000 00000100:00100000:2.0:1762166791.602193:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2771 00000100:00100000:2.0:1762166791.602201:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:46693:x1847765440096000:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166791.602215:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166791.602227:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3e9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d62 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.602249:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c3f0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.602264:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.602273:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166791.602362:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0c3e9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d62 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.602378:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d62 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.602398:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166791.602401:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166791.602404:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166791.602449:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:46693:x1847765440096000:12345-192.168.204.38@tcp:101:dd.0 Request processed in 249us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166791.602457:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2771 00000100:00100000:1.0:1762166791.603964:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.604009:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440096256 00000100:00100000:0.0:1762166791.604016:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440096256 00000100:00100000:0.0:1762166791.604067:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2772 00000100:00100000:0.0:1762166791.604078:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:46693:x1847765440096256:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1762166791.604119:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166791.604141:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c3db lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d5b expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.604156:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.604160:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.604329:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.604362:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.604372:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000001:00080000:0.0:1762166791.604428:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968953 00000004:00010000:0.0:1762166791.604458:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e2cbb1d2 reply state 00000000f6f82d6c transno 4294968954 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.604469:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166791.604502:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.604505:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166791.604509:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166791.604586:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:46693:x1847765440096256:12345-192.168.204.38@tcp:36:dd.0 Request processed in 510us (621us total) trans 4294968954 rc 0/0 00000100:00100000:0.0:1762166791.604596:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2772 00000020:00080000:0.0:1762166791.604601:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166791.605792:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.605888:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440096384 00000100:00100000:3.0:1762166791.605905:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440096384 00000100:00100000:3.0:1762166791.605941:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2773 00000100:00100000:3.0:1762166791.605953:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:46693:x1847765440096384:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1762166791.605970:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166791.605987:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c3fe lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d69 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.606036:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c3fe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d69 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.606050:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c3fe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d69 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.606069:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166791.606072:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166791.606076:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6c00, rc 0) 00000100:00100000:3.0:1762166791.606120:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:46693:x1847765440096384:12345-192.168.204.38@tcp:101:dd.0 Request processed in 170us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.606129:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2773 00000100:00100000:3.0:1762166791.607604:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.607683:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440096640 00000100:00100000:1.0:1762166791.607689:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440096640 00000100:00100000:1.0:1762166791.607726:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2774 00000100:00100000:1.0:1762166791.607735:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:46693:x1847765440096640:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166791.607748:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.607751:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166791.607769:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c3fe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d69 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.607782:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.607786:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166791.607796:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c405 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d70 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.607829:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c40c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.607851:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c40c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.607861:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c40c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000040:00080000:1.0:1762166791.608068:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].114, 88 off17360 00000004:00080000:1.0:1762166791.608078:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410756599199ns, next at 402887219919ns, rc = 0 00000040:00080000:1.0:1762166791.608113:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].108, 88 off16880 00000004:00080000:1.0:1762166791.608121:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410756643381ns, next at 401651240703ns, rc = 0 00000001:00080000:3.0:1762166791.609858:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968955 is committed 00000004:00080000:3.0:1762166791.609868:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00000004:00080000:3.0:1762166791.609881:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 106 committed 00010000:00010000:1.0:1762166791.609882:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.609893:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.609900:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.609906:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477a00 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:3.0:1762166791.609911:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 51 batchid updated 00010000:00010000:1.0:1762166791.609911:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.609919:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000020:00080000:3.0:1762166791.609924:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 50 batchid updated 00000020:00080000:3.0:1762166791.609932:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 49 batchid updated 00010000:00010000:1.0:1762166791.609937:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757b00) 00000020:00080000:3.0:1762166791.609939:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 48 batchid updated 00010000:00010000:1.0:1762166791.609942:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166791.609945:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 47 batchid updated 00010000:00010000:1.0:1762166791.609948:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000020:00080000:3.0:1762166791.609952:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 46 batchid updated 00010000:00010000:1.0:1762166791.609957:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0c38e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166791.609968:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446822784:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1762166791.609980:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 51 00010000:00010000:1.0:1762166791.609991:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.609999:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.610005:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.610012:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.610016:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.610023:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000004:00080000:2.0:1762166791.610032:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc10de000 with version 28 00010000:00010000:1.0:1762166791.610033:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.610038:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166791.610042:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000020:00080000:2.0:1762166791.610048:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 44 cancel update log [0x240000401:0x3:0x0].9: rc = 0 00000100:00100000:0.0:1762166791.610048:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166791.610056:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c3f7 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00080000:3.0:1762166791.610083:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 28 rpc_version 28 00000100:00100000:0.0:1762166791.610100:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446822656:0@lo:2:osp-syn-1-0.0 00000020:00100000:3.0:1762166791.610107:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1762166791.610109:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c40c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d70 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1762166791.610117:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 44 cancel update log [0x200000400:0x2:0x0].21: rc = 0 00000100:00100000:3.0:1762166791.610118:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc2d5d180 x1847765446823040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1762166791.610123:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00000100:00100000:0.0:1762166791.610130:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166791.610131:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166791.610149:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446823040:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1762166791.610150:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c405 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d70 expref: 22 pid: 6496 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1762166791.610154:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945ceffd4600 with version 29 00000020:00080000:2.0:1762166791.610160:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 45 cancel update log [0x240000401:0x3:0x0].10: rc = 0 00010000:00010000:1.0:1762166791.610187:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c40c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d70 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1762166791.610190:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 45 cancel update log [0x200000400:0x2:0x0].22: rc = 0 00000100:00100000:0.0:1762166791.610193:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446822784 00000100:00100000:3.0:1762166791.610198:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166791.610199:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446822784 00010000:00010000:1.0:1762166791.610220:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00000004:00080000:2.0:1762166791.610222:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945cc7c49780 with version 30 00000100:00100000:3.0:1762166791.610226:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4480 going to sleep for 11 seconds 00010000:00010000:1.0:1762166791.610226:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000020:00080000:2.0:1762166791.610228:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 46 cancel update log [0x240000401:0x3:0x0].11: rc = 0 00010000:00010000:1.0:1762166791.610231:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14400, rc 0) 00000100:00100000:0.0:1762166791.610247:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446822656 00000100:00100000:3.0:1762166791.610249:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446823040 00000100:00100000:0.0:1762166791.610251:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446822656 00000100:00100000:3.0:1762166791.610255:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446823040 00000020:00080000:2.0:1762166791.610256:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 46 cancel update log [0x200000400:0x2:0x0].23: rc = 0 00000100:00100000:1.0:1762166791.610281:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:46693:x1847765440096640:12345-192.168.204.38@tcp:101:dd.0 Request processed in 2547us (2678us total) trans 4294968955 rc 0/0 00000004:00080000:2.0:1762166791.610282:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945cc4eee180 with version 31 00000100:00100000:0.0:1762166791.610284:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000020:00080000:2.0:1762166791.610288:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 47 cancel update log [0x240000401:0x3:0x0].12: rc = 0 00000100:00100000:1.0:1762166791.610294:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2774 00000100:00100000:3.0:1762166791.610298:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1762166791.610304:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446822784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166791.610311:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8087:x1847765446823040:12345-0@lo:1000:osp_up1-0.0 00000020:00080000:2.0:1762166791.610316:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 47 cancel update log [0x200000400:0x2:0x0].24: rc = 0 00000004:00080000:2.0:1762166791.610338:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc37e7600 with version 32 00000020:00080000:2.0:1762166791.610340:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 48 cancel update log [0x240000401:0x3:0x0].13: rc = 0 00000020:00080000:2.0:1762166791.610376:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 48 cancel update log [0x200000400:0x2:0x0].25: rc = 0 00000004:00080000:2.0:1762166791.610398:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc37e7b40 with version 33 00000020:00080000:2.0:1762166791.610407:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 49 cancel update log [0x240000401:0x3:0x0].14: rc = 0 00000020:00080000:2.0:1762166791.610431:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 49 cancel update log [0x200000400:0x2:0x0].26: rc = 0 00000004:00080000:2.0:1762166791.610452:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc37e7480 with version 34 00000020:00080000:2.0:1762166791.610456:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 50 cancel update log [0x240000401:0x3:0x0].15: rc = 0 00000100:00100000:3.0:1762166791.610461:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8087:x1847765446823040:12345-0@lo:1000:osp_up1-0.0 Request processed in 151us (269us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1762166791.610467:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446822784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (419us total) trans 21474836677 rc 0/0 00000100:00100000:0.0:1762166791.610503:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1762166791.610504:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000020:00080000:2.0:1762166791.610506:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 50 cancel update log [0x200000400:0x2:0x0].27: rc = 0 00000100:00100000:0.0:1762166791.610522:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1762166791.610527:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446823040:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166791.610534:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446822656:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762166791.610535:0:6526:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc37e7c00 with version 35 00000020:00080000:2.0:1762166791.610540:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 51 cancel update log [0x240000401:0x3:0x0].16: rc = 0 00000004:00080000:1.0:1762166791.610543:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 29 rpc_version 29 00000020:00080000:2.0:1762166791.610565:0:6526:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 51 cancel update log [0x200000400:0x2:0x0].28: rc = 0 00000020:00080000:2.0:1762166791.610574:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 51 00000020:00100000:1.0:1762166791.610574:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00080000:2.0:1762166791.610608:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166791.610618:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446822656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (492us total) trans 17179869361 rc 0/0 00000100:00100000:0.0:1762166791.610624:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1762166791.610644:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc494e300 x1847765446823296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:0.0:1762166791.610650:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5588380/2, rc 0, transno 21474836677 00000100:00100000:0.0:1762166791.610658:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446822784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166791.610667:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446823296:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1762166791.610670:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe35c00/2, rc 0, transno 17179869361 00000100:00100000:0.0:1762166791.610676:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446822656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166791.610702:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.610726:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.610754:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446823296 00000100:00100000:3.0:1762166791.610759:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446823296 00000100:00100000:3.0:1762166791.610861:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1762166791.610868:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8087:x1847765446823296:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166791.610955:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8087:x1847765446823296:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (253us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1762166791.610962:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1762166791.610991:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446823296:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1762166791.610997:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 30 rpc_version 30 00000020:00100000:1.0:1762166791.611005:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166791.611008:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc494c380 x1847765446823552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166791.611017:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446823552:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166791.611034:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.611055:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.611095:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446823552 00000100:00100000:3.0:1762166791.611100:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446823552 00000100:00100000:3.0:1762166791.611136:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1762166791.611142:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8087:x1847765446823552:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166791.611218:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8087:x1847765446823552:12345-0@lo:1000:osp_up1-0.0 Request processed in 76us (181us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1762166791.611226:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1762166791.611254:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446823552:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1762166791.611262:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 31 rpc_version 31 00000020:00100000:1.0:1762166791.611271:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166791.611275:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc494ce00 x1847765446823808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166791.611284:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446823808:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166791.611300:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.611314:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.611328:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446823808 00000100:00100000:3.0:1762166791.611333:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446823808 00000100:00100000:3.0:1762166791.611368:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1762166791.611374:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8087:x1847765446823808:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166791.611444:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8087:x1847765446823808:12345-0@lo:1000:osp_up1-0.0 Request processed in 69us (141us total) trans 4294967465 rc 0/0 00000100:00100000:3.0:1762166791.611451:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1762166791.611473:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446823808:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1762166791.611535:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 32 rpc_version 32 00000020:00100000:1.0:1762166791.611546:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166791.611551:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc494d500 x1847765446824064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166791.611564:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446824064:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166791.611587:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.611606:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.611616:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446824064 00000100:00100000:3.0:1762166791.611620:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446824064 00000100:00100000:3.0:1762166791.611641:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1762166791.611645:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8087:x1847765446824064:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166791.611703:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:8087:x1847765446824064:12345-0@lo:1000:osp_up1-0.0 Request processed in 57us (115us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1762166791.611711:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1762166791.611749:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446824064:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1762166791.611761:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 33 rpc_version 33 00000020:00100000:1.0:1762166791.611775:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166791.611780:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc494d880 x1847765446824320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166791.611794:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446824320:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166791.611821:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.611839:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.611850:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446824320 00000100:00100000:3.0:1762166791.611855:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446824320 00000100:00100000:3.0:1762166791.611884:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1762166791.611890:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc635e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:8087:x1847765446824320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166791.611948:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc635e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:8087:x1847765446824320:12345-0@lo:1000:osp_up1-0.0 Request processed in 59us (127us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1762166791.611953:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1762166791.611984:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446824320:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1762166791.612002:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 34 rpc_version 34 00000020:00100000:1.0:1762166791.612015:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166791.612021:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc494ed80 x1847765446824576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166791.612036:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446824576:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166791.612113:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.612132:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.612138:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446824576 00000100:00100000:3.0:1762166791.612142:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446824576 00000100:00100000:3.0:1762166791.612166:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1762166791.612175:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:8087:x1847765446824576:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166791.612241:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:8087:x1847765446824576:12345-0@lo:1000:osp_up1-0.0 Request processed in 68us (127us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1762166791.612248:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1762166791.612260:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446824576:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1762166791.612274:0:8087:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cf1fe2d80 version 35 rpc_version 35 00000020:00100000:1.0:1762166791.612286:0:8087:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166791.612291:0:8087:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc494f480 x1847765446824832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166791.612303:0:8087:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446824832:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166791.612327:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.612356:0:8087:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.612431:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446824832 00000100:00100000:3.0:1762166791.612436:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446824832 00000100:00100000:3.0:1762166791.612468:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1762166791.612475:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:8087:x1847765446824832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166791.612561:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:8087:x1847765446824832:12345-0@lo:1000:osp_up1-0.0 Request processed in 87us (233us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1762166791.612569:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1762166791.612600:0:8087:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8087:1847765446824832:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166791.612660:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.612853:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440096768 00000100:00100000:0.0:1762166791.612859:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440096768 00000100:00080000:2.0:1762166791.612904:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166791.612908:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 990 00000100:00100000:0.0:1762166791.612916:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+8:46693:x1847765440096768:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166791.612927:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.612942:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d77 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166791.612960:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166791.612975:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166791.612977:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166791.612984:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 9 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.613012:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 9 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.613023:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89000, rc 0) 00000100:00100000:0.0:1762166791.613061:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:46693:x1847765440096768:12345-192.168.204.38@tcp:101:dd.0 Request processed in 146us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.613067:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 990 00000100:00100000:2.0:1762166791.614867:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.614956:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440096896 00000100:00100000:1.0:1762166791.614964:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440096896 00002000:00010000:1.0:1762166791.615007:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/75 (0->18446744073709551615) 00002000:00100000:1.0:1762166791.615013:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558aa00 with x1847765440096896 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166791.615023:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558aa00. 00000100:00100000:1.0:1762166791.615055:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 465 00000100:00100000:1.0:1762166791.615065:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440096896:12345-192.168.204.38@tcp:10:dd.0 00002000:00010000:1.0:1762166791.615212:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166791.615216:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb mtime from disk: 0 -> 1762166791 00002000:00010000:1.0:1762166791.615227:0:16567:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166791.615229:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb ctime from disk: 0 -> 1762166791 00002000:00010000:1.0:1762166791.615231:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166791.615291:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440096896:12345-192.168.204.38@tcp:10:dd.0 Request processed in 228us (428us total) trans 21474836678 rc 0/0 00000100:00100000:1.0:1762166791.615301:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 465 00002000:00010000:1.0:1762166791.615305:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/75 (0->18446744073709551615) 00002000:00100000:1.0:1762166791.615308:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558aa00 with x1847765440096896 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166791.615312:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558aa00. 00000100:00100000:3.0:1762166791.668889:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.669040:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440097152 00000100:00100000:1.0:1762166791.669054:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440097152 00000100:00100000:1.0:1762166791.669136:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2775 00000100:00100000:1.0:1762166791.669147:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:46693:x1847765440097152:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166791.669179:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.669183:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166791.669220:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c40c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d70 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.669248:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.669255:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166791.669271:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c41a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d7e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.669336:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c421 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.669362:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c421 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.669393:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c421 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00080000:1.0:1762166791.669709:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4c:0x0], index 0: 0 00000040:00080000:1.0:1762166791.669800:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].115, 88 off17448 00000004:00080000:1.0:1762166791.669809:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410818330707ns, next at 402887219919ns, rc = 0 00000040:00080000:1.0:1762166791.669837:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].116, 88 off17536 00000004:00080000:1.0:1762166791.669843:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410818364705ns, next at 402887219919ns, rc = 0 00000040:00080000:1.0:1762166791.669865:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].109, 88 off16968 00000004:00080000:1.0:1762166791.669870:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410818391962ns, next at 401651240703ns, rc = 0 00000001:00080000:3.0:1762166791.671511:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968956 is committed 00000004:00080000:3.0:1762166791.671528:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00000004:00080000:3.0:1762166791.671539:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 108 committed 00000004:00080000:3.0:1762166791.671552:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 107 committed 00000100:00100000:2.0:1762166791.671728:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446825088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166791.671731:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446824960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166791.671748:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446825216:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166791.671772:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c421 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d7e expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.671793:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.671797:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166791.671819:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c41a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d7e expref: 22 pid: 6496 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1762166791.671827:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166791.671861:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c421 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d7e expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166791.671888:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166791.671899:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.671905:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166791.671907:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446825088 00010000:00010000:1.0:1762166791.671909:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14800, rc 0) 00000100:00100000:3.0:1762166791.671919:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446825088 00000100:00100000:2.0:1762166791.671996:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.672004:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:46693:x1847765440097152:12345-192.168.204.38@tcp:101:dd.0 Request processed in 2853us (3123us total) trans 4294968956 rc 0/0 00000100:00100000:0.0:1762166791.672016:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446825216 00000100:00100000:3.0:1762166791.672018:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446824960 00000100:00100000:0.0:1762166791.672026:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446825216 00000100:00100000:1.0:1762166791.672027:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2775 00000100:00100000:3.0:1762166791.672030:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446824960 00000100:00100000:2.0:1762166791.672064:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1762166791.672078:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446825088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166791.672096:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1762166791.672119:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446825216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166791.672120:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1762166791.672138:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446824960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762166791.672279:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166791.672284:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb mtime from disk: 1762166791 -> 1762166791 00002000:00010000:3.0:1762166791.672300:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1762166791.672302:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446825088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (481us total) trans 17179869362 rc 0/0 00002000:00010000:3.0:1762166791.672305:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb ctime from disk: 1762166791 -> 1762166791 00002000:00010000:3.0:1762166791.672312:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166791.672313:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1762166791.672355:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3635:x1847765446825216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (451us total) trans 21474836680 rc 0/0 00000100:00100000:0.0:1762166791.672366:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000004:00080000:1.0:1762166791.672388:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc558bb80/2, rc 0, transno 21474836680 00000004:00080000:2.0:1762166791.672395:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe36300/2, rc 0, transno 17179869362 00000100:00100000:2.0:1762166791.672408:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446825088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166791.672411:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446825216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166791.672448:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446824960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 314us (454us total) trans 21474836679 rc 0/0 00000100:00100000:3.0:1762166791.672459:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000004:00080000:2.0:1762166791.672468:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5589f80/2, rc 0, transno 21474836679 00000100:00100000:2.0:1762166791.672508:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446824960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166791.675800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.675854:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440097280 00000100:00100000:1.0:1762166791.675864:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440097280 00002000:00100000:1.0:1762166791.675907:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4b:0x0] (0->2097151) req@ffff945bc95b2d80 x1847765440097280/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:577/0 lens 488/0 e 0 to 0 dl 1762166802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166791.675917:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc95b2d80 with x1847765440097280 ext(0->2097151) 00002000:00010000:1.0:1762166791.675924:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc95b2d80 00000100:00100000:1.0:1762166791.675953:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 466 00000100:00100000:1.0:1762166791.675962:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440097280:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:1.0:1762166791.686920:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440097280:12345-192.168.204.38@tcp:4:dd.0 Request processed in 10947us (11117us total) trans 21474836681 rc 0/0 00000100:00100000:1.0:1762166791.686935:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 466 00002000:00100000:1.0:1762166791.686949:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4b:0x0] (0->2097151) req@ffff945bc95b2d80 x1847765440097280/t21474836681(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:577/0 lens 488/448 e 0 to 0 dl 1762166802 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166791.686960:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc95b2d80 with x1847765440097280 ext(0->2097151) 00002000:00010000:1.0:1762166791.686967:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc95b2d80 00000100:00100000:2.0:1762166791.690416:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.690535:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440097408 00000100:00100000:3.0:1762166791.690549:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440097408 00000100:00100000:3.0:1762166791.690621:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 994 00000100:00100000:3.0:1762166791.690635:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:46693:x1847765440097408:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1762166791.690659:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166791.690686:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d85 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166791.690713:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166791.690739:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.690742:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.690752:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.690770:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.690784:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6a00, rc 0) 00000100:00100000:3.0:1762166791.690850:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:46693:x1847765440097408:12345-192.168.204.38@tcp:101:dd.0 Request processed in 219us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.690859:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 994 00000100:00100000:2.0:1762166791.702973:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.703111:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440097664 00000100:00100000:1.0:1762166791.703127:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440097664 00000100:00100000:1.0:1762166791.703198:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 807 00000100:00100000:1.0:1762166791.703210:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:46693:x1847765440097664:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:1.0:1762166791.703472:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:46693:x1847765440097664:12345-192.168.204.38@tcp:35:dd.0 Request processed in 265us (514us total) trans 4294968957 rc 0/0 00000100:00100000:1.0:1762166791.703509:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 807 00000100:00100000:0.0:1762166791.714594:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.714748:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440097792 00000100:00100000:1.0:1762166791.714781:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440097792 00000100:00100000:1.0:1762166791.714855:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2776 00000100:00100000:1.0:1762166791.714868:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:46695:x1847765440097792:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.714892:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.714929:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c42f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d8c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.714991:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c436 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.715005:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.715016:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166791.715068:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166791.715072:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166791.715096:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.715119:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c42f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d8c expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.715137:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c436 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d8c expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.715145:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166791.715148:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166791.715152:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14400, rc 0) 00000100:00100000:1.0:1762166791.715222:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:46695:x1847765440097792:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 356us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.715236:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2776 00000100:00100000:2.0:1762166791.717025:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.717215:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440098048 00000100:00100000:1.0:1762166791.717226:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440098048 00000100:00100000:1.0:1762166791.717291:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2777 00000100:00100000:1.0:1762166791.717301:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:46695:x1847765440098048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.717318:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.717337:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c43d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d93 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.717414:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717425:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717435:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717448:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717455:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717462:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717566:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717573:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717593:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717599:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717604:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.717608:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717614:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717625:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166791.717628:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166791.717632:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717637:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717650:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717655:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717661:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717666:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.717669:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717683:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717691:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945cd4634c00) 00010000:00010000:1.0:1762166791.717693:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166791.717696:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717702:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c44b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.717746:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c43d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d93 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.717757:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166791.717760:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166791.717764:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c43d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d93 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.717773:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15e00, rc 0) 00000100:00100000:1.0:1762166791.717836:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:46695:x1847765440098048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 537us (820us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166791.717843:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2777 00000100:00100000:2.0:1762166791.720260:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.720320:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440098176 00000100:00100000:1.0:1762166791.720329:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440098176 00000100:00100000:1.0:1762166791.720403:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2778 00000100:00100000:1.0:1762166791.720413:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:46695:x1847765440098176:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166791.720522:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720556:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720571:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720587:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720594:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720601:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720668:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720677:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720683:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166791.720723:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00000004:00200000:1.0:1762166791.720728:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166791.720739:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720752:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720759:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720776:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720782:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720788:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.720792:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720800:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720811:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166791.720827:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166791.720832:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720837:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720849:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720853:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720859:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720864:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.720867:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720891:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720899:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945cd4634a00) 00010000:00010000:1.0:1762166791.720902:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166791.720905:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720911:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720927:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720933:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720939:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720945:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.720948:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720954:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720961:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.720963:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166791.720966:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.720972:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c460 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166791.721057:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:46695:x1847765440098176:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 645us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.721066:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2778 00000100:00100000:0.0:1762166791.728683:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.728735:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440098432 00000100:00100000:1.0:1762166791.728746:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440098432 00000100:00100000:1.0:1762166791.728810:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2779 00000100:00100000:1.0:1762166791.728827:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:46698:x1847765440098432:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:1.0:1762166791.728849:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.728870:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d9a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.728940:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.728959:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.728969:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.728984:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.728991:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.728997:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729092:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729114:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729121:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166791.729131:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00010000:00010000:1.0:1762166791.729206:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729213:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729219:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729225:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729231:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.729235:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729241:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729252:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166791.729255:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166791.729259:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729266:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c46e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729288:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729294:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729299:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729304:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.729307:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729313:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729321:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945cd4634c00) 00010000:00010000:1.0:1762166791.729323:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166791.729326:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729332:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c475 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.729385:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.729399:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.729406:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.729414:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166791.729417:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15400, rc 0) 00000100:00100000:1.0:1762166791.729473:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:46698:x1847765440098432:12345-192.168.204.38@tcp:101:bash.0 Request processed in 650us (798us total) trans 4294968958 rc 0/0 00000100:00100000:1.0:1762166791.729501:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2779 00000100:00100000:2.0:1762166791.735923:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.735963:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440098560 00000100:00100000:1.0:1762166791.735978:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440098560 00002000:00100000:1.0:1762166791.736022:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4b:0x0] (0->32767) req@ffff945cf1e6ca80 x1847765440098560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:577/0 lens 488/0 e 0 to 0 dl 1762166802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166791.736031:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ca80 with x1847765440098560 ext(0->32767) 00002000:00010000:1.0:1762166791.736035:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6ca80 00000100:00100000:1.0:1762166791.736058:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 467 00000100:00100000:1.0:1762166791.736064:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440098560:12345-192.168.204.38@tcp:3:md5sum.0 00000100:00100000:1.0:1762166791.737294:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440098560:12345-192.168.204.38@tcp:3:md5sum.0 Request processed in 1225us (1375us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1762166791.737303:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 467 00002000:00100000:1.0:1762166791.737311:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4b:0x0] (0->32767) req@ffff945cf1e6ca80 x1847765440098560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:577/0 lens 488/440 e 0 to 0 dl 1762166802 ref 1 fl Complete:/600/0 rc 32768/32768 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166791.737319:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ca80 with x1847765440098560 ext(0->32767) 00002000:00010000:1.0:1762166791.737323:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6ca80 00000100:00100000:0.0:1762166791.743043:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.743103:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440098688 00000100:00100000:1.0:1762166791.743113:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440098688 00002000:00100000:1.0:1762166791.743158:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4b:0x0] (32768->2097151) req@ffff945bcbe35500 x1847765440098688/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:577/0 lens 488/0 e 0 to 0 dl 1762166802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166791.743169:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcbe35500 with x1847765440098688 ext(32768->2097151) 00002000:00010000:1.0:1762166791.743188:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcbe35500 00000100:00100000:1.0:1762166791.743221:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 468 00000100:00100000:1.0:1762166791.743230:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440098688:12345-192.168.204.38@tcp:3:md5sum.0 00000100:00100000:1.0:1762166791.748806:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440098688:12345-192.168.204.38@tcp:3:md5sum.0 Request processed in 5568us (5763us total) trans 0 rc 2064384/2064384 00000100:00100000:1.0:1762166791.748820:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 468 00002000:00100000:1.0:1762166791.748835:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4b:0x0] (32768->2097151) req@ffff945bcbe35500 x1847765440098688/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:577/0 lens 488/440 e 0 to 0 dl 1762166802 ref 1 fl Complete:/600/0 rc 2064384/2064384 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166791.748845:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcbe35500 with x1847765440098688 ext(32768->2097151) 00002000:00010000:1.0:1762166791.748851:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcbe35500 00000100:00100000:2.0:1762166791.763084:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.763164:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440098944 00000100:00100000:1.0:1762166791.763175:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440098944 00000100:00100000:1.0:1762166791.763230:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 808 00000100:00100000:1.0:1762166791.763242:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:46698:x1847765440098944:12345-192.168.204.38@tcp:35:md5sum.0 00000100:00100000:1.0:1762166791.763522:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:46698:x1847765440098944:12345-192.168.204.38@tcp:35:md5sum.0 Request processed in 281us (448us total) trans 4294968959 rc 0/0 00000100:00100000:1.0:1762166791.763532:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 808 00000100:00100000:2.0:1762166791.774157:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.774463:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440099200 00000100:00100000:1.0:1762166791.774505:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440099200 00000100:00100000:1.0:1762166791.774576:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2780 00000100:00100000:1.0:1762166791.774587:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:46699:x1847765440099200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.774610:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.774629:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c48a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7da1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.774756:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.774771:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.774780:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.774813:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.774826:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 27 pid: 6496 timeout: 510 lvb_type: 0 00000100:00100000:1.0:1762166791.774840:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446825344:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166791.774949:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166791.776413:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446825344:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166791.776436:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166791.776576:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.776674:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440099328 00000100:00100000:3.0:1762166791.776681:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440099328 00010000:00010000:3.0:1762166791.776712:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 28 pid: 6496 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1762166791.776742:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 650 00000100:00100000:3.0:1762166791.776750:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440099328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166791.776763:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166791.776770:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 28 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.776782:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 28 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.776801:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c47c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d9a expref: 28 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.776815:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166791.776826:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.776834:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.776841:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.776866:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166791.776902:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.776912:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166791.776915:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440099328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 164us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.776928:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 650 00000004:00200000:1.0:1762166791.776933:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00010000:00010000:1.0:1762166791.777044:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c48a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.777081:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.777089:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.777092:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166791.777094:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15200, rc 0) 00000100:00100000:1.0:1762166791.777133:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:46699:x1847765440099200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2549us (2987us total) trans 4294968960 rc 0/0 00000100:00100000:1.0:1762166791.777140:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2780 00000100:00100000:2.0:1762166791.778640:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.778679:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440099456 00000100:00100000:1.0:1762166791.778686:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440099456 00000100:00100000:1.0:1762166791.778729:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2781 00000100:00100000:1.0:1762166791.778737:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:46699:x1847765440099456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.778755:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.778769:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c49f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7da8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.778839:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.778852:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.778859:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.778886:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.778925:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 28 pid: 6496 timeout: 510 lvb_type: 0 00000100:00100000:1.0:1762166791.778938:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446825472:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166791.778999:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166791.780177:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.780253:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446825472:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166791.780276:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166791.780514:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440099584 00000100:00100000:3.0:1762166791.780520:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440099584 00010000:00010000:3.0:1762166791.780545:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 29 pid: 6496 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1762166791.780580:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 651 00000100:00100000:3.0:1762166791.780587:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765440099584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166791.780596:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166791.780600:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 29 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.780608:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 29 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.780622:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c491 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da1 expref: 29 pid: 6496 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.780635:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166791.780639:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.780647:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.780653:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166791.780675:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166791.780692:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.780699:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166791.780726:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440099584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.780735:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 651 00000004:00200000:1.0:1762166791.780738:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00000004:00200000:1.0:1762166791.780744:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166791.780764:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.780790:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c49f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da8 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.780802:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da8 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.780810:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.780813:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166791.780821:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15000, rc 0) 00000100:00100000:1.0:1762166791.780852:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:46699:x1847765440099456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2116us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.780860:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2781 00000100:00100000:0.0:1762166791.783332:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.783438:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440099840 00000100:00100000:1.0:1762166791.783446:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440099840 00000100:00100000:1.0:1762166791.783527:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2782 00000100:00100000:1.0:1762166791.783538:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:46699:x1847765440099840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.783563:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.783583:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c4ad lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7daf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.783679:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c4b4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.783693:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166791.783704:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166791.783715:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00010000:00010000:1.0:1762166791.783812:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c4ad lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7daf expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.783826:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7daf expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.783834:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.783837:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166791.783851:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14c00, rc 0) 00000100:00100000:1.0:1762166791.783908:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:46699:x1847765440099840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 371us (586us total) trans 4294968961 rc 0/0 00000100:00100000:1.0:1762166791.783916:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2782 00000100:00100000:2.0:1762166791.785706:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.785743:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440100096 00000100:00100000:3.0:1762166791.785750:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440100096 00000100:00100000:2.0:1762166791.785750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.785805:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440099968 00000100:00100000:2.0:1762166791.785809:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440099968 00000100:00100000:3.0:1762166791.785834:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 995 00000100:00100000:2.0:1762166791.785842:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 996 00000100:00100000:3.0:1762166791.785847:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440100096:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166791.785858:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440099968:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166791.785886:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.785887:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.785913:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 14 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.785923:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 14 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.785933:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166791.785934:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166791.785935:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166791.785940:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166791.785942:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.785944:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.785987:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 14 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.785990:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 14 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.786005:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 14 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:2.0:1762166791.786010:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 14 pid: 9165 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1762166791.786029:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446825600:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166791.786031:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446825728:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166791.786106:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.786107:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.787078:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446825600:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166791.787097:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166791.787162:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446825728:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166791.787175:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166791.788543:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.788684:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440100224 00000100:00100000:1.0:1762166791.788691:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440100224 00002000:00100000:1.0:1762166791.788723:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4c:0x0] (2097152->3145727) req@ffff945cf1e6f800 x1847765440100224/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:577/0 lens 488/0 e 0 to 0 dl 1762166802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166791.788731:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6f800 with x1847765440100224 ext(2097152->3145727) 00010000:00010000:1.0:1762166791.788736:0:16567:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 15 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1762166791.788745:0:16567:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 15 pid: 9165 timeout: 510 lvb_type: 0 00002000:00010000:1.0:1762166791.788750:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945cf1e6f800 00000100:00100000:1.0:1762166791.788779:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:1.0:1762166791.788788:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440100224:12345-192.168.204.38@tcp:4:md5sum.0 00000100:00100000:0.0:1762166791.789730:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.789766:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440100352 00000100:00100000:3.0:1762166791.789772:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440100352 00010000:00010000:3.0:1762166791.789794:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 17 pid: 9165 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1762166791.789826:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 652 00000100:00100000:3.0:1762166791.789833:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440100352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166791.789843:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1762166791.789855:0:8398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1762166791.789858:0:8398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:3.0:1762166791.789865:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 17 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.789878:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 17 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.789898:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c413 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d77 expref: 17 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.789913:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.789915:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.789919:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.789929:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.789968:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.790001:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.790016:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.790036:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.790045:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166791.790047:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440100352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (316us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166791.790062:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.790068:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a4200 already unused, calling callback (ffffffffc0cd9320) 00000100:00100000:3.0:1762166791.790075:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 652 00010000:00010000:0.0:1762166791.790075:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.790086:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.790099:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.790117:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c4c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166791.790173:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440099968:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 4318us (4423us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.790180:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 996 00000100:00100000:1.0:1762166791.793808:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440100224:12345-192.168.204.38@tcp:4:md5sum.0 Request processed in 5013us (5261us total) trans 21474836682 rc 0/0 00000100:00100000:1.0:1762166791.793821:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00002000:00100000:1.0:1762166791.793834:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4c:0x0] (2097152->3145727) req@ffff945cf1e6f800 x1847765440100224/t21474836682(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:577/0 lens 488/448 e 0 to 0 dl 1762166802 ref 1 fl Complete:H/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166791.793844:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6f800 with x1847765440100224 ext(2097152->3145727) 00010000:00010000:1.0:1762166791.793853:0:16567:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 15 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:1.0:1762166791.793878:0:16567:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 15 pid: 9165 timeout: 510 lvb_type: 0 00002000:00010000:1.0:1762166791.793886:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945cf1e6f800 00000100:00100000:2.0:1762166791.795643:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.795734:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440100480 00000100:00100000:3.0:1762166791.795743:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440100480 00010000:00010000:3.0:1762166791.795775:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 15 pid: 9165 timeout: 510 lvb_type: 0 00000100:00100000:3.0:1762166791.795818:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 653 00000100:00100000:3.0:1762166791.795827:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440100480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166791.795840:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1762166791.795853:0:8398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1762166791.795856:0:8398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb mtime from disk: 0 -> 1762166791 00002000:00010000:3.0:1762166791.795858:0:8398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb atime from disk: 0 -> 1762166791 00002000:00010000:3.0:1762166791.795860:0:8398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb ctime from disk: 0 -> 1762166791 00002000:00010000:3.0:1762166791.795862:0:8398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1762166791.795867:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 15 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.795879:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 15 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.795906:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c428 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d85 expref: 15 pid: 9165 timeout: 510 lvb_type: 0 00010000:00010000:3.0:1762166791.795935:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.795937:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.795942:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.795952:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.795987:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166791.796026:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166791.796036:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440100480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (396us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166791.796042:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166791.796048:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 653 00010000:00010000:1.0:1762166791.796082:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.796092:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.796100:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.796112:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166791.796116:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.796125:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.796163:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.796171:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6e00/0x2f180c4effb0c4c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166791.796254:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440100096:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 10410us (10551us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.796263:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 995 00000100:00100000:2.0:1762166791.797258:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.797304:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440100736 00000100:00100000:0.0:1762166791.797312:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440100736 00000100:00100000:0.0:1762166791.797366:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2783 00000100:00100000:0.0:1762166791.797376:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:46699:x1847765440100736:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166791.797418:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166791.797434:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c421 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d7e expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.797451:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c4a6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7da8 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.797460:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.797463:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.797513:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.797525:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.797534:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00080000:0.0:1762166791.797708:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x46:0x0], index 1: 0 00000040:00080000:0.0:1762166791.797785:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].117, 88 off17624 00000004:00080000:0.0:1762166791.797795:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410946316187ns, next at 402887219919ns, rc = 0 00000040:00080000:0.0:1762166791.797831:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].118, 88 off17712 00000004:00080000:0.0:1762166791.797836:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410946357895ns, next at 402887219919ns, rc = 0 00000040:00080000:0.0:1762166791.797857:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].110, 88 off17056 00000004:00080000:0.0:1762166791.797862:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410946384695ns, next at 401651240703ns, rc = 0 00000040:00080000:0.0:1762166791.797887:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].111, 88 off17144 00000004:00080000:0.0:1762166791.797892:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410946414400ns, next at 401651240703ns, rc = 0 00000001:00080000:3.0:1762166791.799099:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968962 is committed 00000004:00080000:3.0:1762166791.799105:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000004:00080000:3.0:1762166791.799117:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000004:00080000:3.0:1762166791.799119:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 110 committed 00000004:00080000:3.0:1762166791.799129:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 109 committed 00000100:00100000:2.0:1762166791.799202:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446826112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166791.799202:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446826240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166791.799215:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446825984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166791.799272:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166791.799279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166791.799295:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446825856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166791.799322:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1762166791.799327:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000088d51e5b reply state 00000000d3421ef0 transno 4294968962 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166791.799353:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446826240 00010000:00010000:0.0:1762166791.799356:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166791.799359:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446826240 00010000:00010000:0.0:1762166791.799368:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00000100:00100000:2.0:1762166791.799370:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446825984 00010000:00010000:0.0:1762166791.799372:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166791.799375:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446825984 00000100:00100000:0.0:1762166791.799377:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166791.799394:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446825856 00000100:00100000:1.0:1762166791.799398:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446825856 00000100:00100000:2.0:1762166791.799402:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1762166791.799413:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446826240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166791.799414:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1762166791.799429:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446825984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166791.799435:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1762166791.799445:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446825856:12345-0@lo:2:osp-syn-1-0.0 00010000:00080000:0.0:1762166791.799448:0:7432:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166791.799464:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46699:x1847765440100736:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2088us (2210us total) trans 4294968962 rc 0/0 00000100:00100000:0.0:1762166791.799472:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2783 00010000:00010000:0.0:1762166791.799529:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.799537:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.799545:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.799559:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.799564:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166791.799572:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3635:x1847765446826240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (297us total) trans 17179869364 rc 0/0 00000100:00100000:1.0:1762166791.799572:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3636:x1847765446825856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (246us total) trans 17179869363 rc 0/0 00010000:00010000:0.0:1762166791.799575:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166791.799584:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1762166791.799587:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765446825984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (307us total) trans 21474836683 rc 0/0 00000100:00100000:2.0:1762166791.799591:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00010000:00010000:0.0:1762166791.799594:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.799599:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166791.799601:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00010000:00010000:0.0:1762166791.799605:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.799613:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c4d0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00080000:3.0:1762166791.799652:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6c000/2, rc 0, transno 21474836683 00000100:00100000:3.0:1762166791.799659:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446825984:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762166791.799745:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a08e00/2, rc 0, transno 17179869364 00000100:00100000:2.0:1762166791.799752:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446826240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762166791.799775:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc494df80/2, rc 0, transno 17179869363 00000100:00100000:2.0:1762166791.799780:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446825856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166791.799792:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.799815:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446826112 00000100:00100000:1.0:1762166791.799819:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446826112 00000100:00100000:1.0:1762166791.799839:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1762166791.799845:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446826112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166791.799941:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765446826112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (146us total) trans 21474836684 rc 0/0 00000100:00100000:1.0:1762166791.799953:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000004:00080000:2.0:1762166791.800000:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6d880/2, rc 0, transno 21474836684 00000100:00100000:2.0:1762166791.800006:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446826112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166791.800932:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.800977:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440100864 00000100:00100000:0.0:1762166791.800983:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440100864 00000100:00100000:0.0:1762166791.801024:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2784 00000100:00100000:0.0:1762166791.801033:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:46699:x1847765440100864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166791.801046:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.801059:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7db6 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.801099:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.801111:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.801126:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.801134:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166791.801136:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88a00, rc 0) 00000100:00100000:0.0:1762166791.801169:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46699:x1847765440100864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 138us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.801173:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2784 00000100:00100000:0.0:1762166791.803132:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.803190:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440100992 00000100:00100000:1.0:1762166791.803196:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440100992 00000100:00100000:1.0:1762166791.803241:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2785 00000100:00100000:1.0:1762166791.803250:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46699:x1847765440100992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.803263:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.803276:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c4de lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7dbd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.803359:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c4e5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.803372:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.803381:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166791.803405:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145729 00000004:00200000:1.0:1762166791.803410:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166791.803425:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.803448:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c4de lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dbd expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.803461:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dbd expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.803468:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.803507:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166791.803511:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15600, rc 0) 00000100:00100000:1.0:1762166791.803559:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:46699:x1847765440100992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 309us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.803566:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2785 00000100:00100000:2.0:1762166791.806249:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.806302:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440101120 00000100:00100000:1.0:1762166791.806309:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440101120 00000100:00100000:1.0:1762166791.806357:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1001 00000100:00100000:1.0:1762166791.806368:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440101120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.806382:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.806399:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7dc4 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166791.806420:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4b:0x0] initial LVB size: 2097152, mtime: 0x69088807, atime: 0x0, ctime: 0x69088807, blocks: 0x1000 00010000:00010000:1.0:1762166791.806437:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166791.806439:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166791.806448:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 14 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166791.806469:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 14 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166791.806501:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15e00, rc 0) 00000100:00100000:1.0:1762166791.806552:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440101120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 186us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.806560:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1001 00000100:00100000:0.0:1762166791.806610:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.806711:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440101248 00000100:00100000:1.0:1762166791.806733:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440101248 00000100:00100000:1.0:1762166791.806789:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1002 00000100:00100000:1.0:1762166791.806798:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440101248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.806819:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.806839:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7dcb expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166791.806862:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4c:0x0] initial LVB size: 3145728, mtime: 0x69088807, atime: 0x69088807, ctime: 0x69088807, blocks: 0x800 00010000:00010000:1.0:1762166791.806878:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166791.806880:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166791.806889:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 15 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166791.806904:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 15 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166791.806916:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14600, rc 0) 00000100:00100000:1.0:1762166791.806966:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440101248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 169us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.806973:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1002 00000100:00100000:3.0:1762166791.831235:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.831273:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.831298:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440101376 00000100:00100000:1.0:1762166791.831308:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440101376 00000100:00100000:1.0:1762166791.831376:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440101504 00000100:00100000:1.0:1762166791.831380:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440101504 00000100:00100000:2.0:1762166791.831400:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1003 00000100:00100000:0.0:1762166791.831417:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1004 00000100:00100000:2.0:1762166791.831428:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440101376:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166791.831434:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440101504:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166791.831638:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440101504:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 206us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166791.831639:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440101376:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 219us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166791.831655:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1003 00000100:00100000:0.0:1762166791.831664:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1004 00000100:00100000:0.0:1762166791.832879:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.832921:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.832922:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440101632 00000100:00100000:2.0:1762166791.832931:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440101632 00000100:00100000:1.0:1762166791.832973:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440101760 00000100:00100000:2.0:1762166791.832978:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1005 00000100:00100000:1.0:1762166791.832981:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440101760 00000100:00100000:2.0:1762166791.832992:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440101632:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166791.833021:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1006 00000100:00100000:1.0:1762166791.833034:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440101760:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166791.833069:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440101632:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166791.833074:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1005 00000100:00100000:1.0:1762166791.833115:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440101760:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.833122:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1006 00000100:00100000:1.0:1762166791.835310:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.835385:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440101888 00000100:00100000:2.0:1762166791.835395:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440101888 00000100:00100000:2.0:1762166791.835471:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 469 00000100:00100000:2.0:1762166791.835512:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440101888:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166791.835561:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.835581:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.835584:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.835593:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.835633:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166791.835763:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.835936:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440102016 00000100:00100000:3.0:1762166791.835951:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440102016 00000100:00100000:3.0:1762166791.836035:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 470 00000100:00100000:3.0:1762166791.836049:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440102016:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166791.836084:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.836099:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.836101:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.836107:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.836120:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.841517:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.841537:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.841546:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.841553:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c6a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166791.841567:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.841575:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.841592:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.841603:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6a00/0x2f180c4effb0c501 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166791.841842:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440102016:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 5792us (6074us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166791.841854:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 470 00010000:00010000:2.0:1762166791.843884:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.843898:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.843905:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.843917:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a5800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166791.843921:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.843929:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.843944:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.843950:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5800/0x2f180c4effb0c4fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166791.844035:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440101888:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 8524us (8732us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1762166791.844044:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 469 00000100:00100000:0.0:1762166791.848263:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.848313:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440102144 00000100:00100000:2.0:1762166791.848322:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440102144 00000100:00080000:0.0:1762166791.848391:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166791.848417:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 471 00000100:00100000:2.0:1762166791.848427:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+6:2417:x1847765440102144:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166791.848503:0:16567:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166791.848513:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.848526:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.848528:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.848533:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.848547:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166791.856463:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869365 is committed 00000001:00080000:3.0:1762166791.856515:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869363 is committed 00000001:00080000:3.0:1762166791.856520:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869364 is committed 00000001:00080000:3.0:1762166791.856527:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869360 is committed 00002000:00010000:2.0:1762166791.856643:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1762166791.856648:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb mtime from disk: 0 -> 1762166792 00002000:00010000:2.0:1762166791.856649:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb ctime from disk: 0 -> 1762166792 00002000:00010000:2.0:1762166791.856651:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1762166791.856663:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.856674:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.856687:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.856691:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a4c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166791.856694:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.856699:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.856717:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.856724:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c508 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166791.856824:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+6:2417:x1847765440102144:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 8393us (8564us total) trans 17179869365 rc 0/0 00000100:00100000:2.0:1762166791.856835:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 471 00000100:00100000:0.0:1762166791.860979:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.861083:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440102272 00000100:00100000:2.0:1762166791.861098:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440102272 00000100:00100000:2.0:1762166791.861196:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 472 00000100:00100000:2.0:1762166791.861209:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+6:2419:x1847765440102272:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166791.861259:0:16567:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166791.861269:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.861300:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.861302:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.861308:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.861332:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166791.870103:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869366 is committed 00002000:00010000:2.0:1762166791.870204:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1762166791.870208:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb mtime from disk: 0 -> 1762166792 00002000:00010000:2.0:1762166791.870209:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb ctime from disk: 0 -> 1762166792 00002000:00010000:2.0:1762166791.870211:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:2.0:1762166791.870222:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.870230:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.870236:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.870240:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a5800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166791.870243:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.870249:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.870270:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.870275:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c50f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166791.870354:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+6:2419:x1847765440102272:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 9145us (9387us total) trans 17179869366 rc 0/0 00000100:00100000:2.0:1762166791.870361:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 472 00000100:00100000:0.0:1762166791.879643:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.879739:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440102528 00000100:00100000:1.0:1762166791.879755:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440102528 00000100:00100000:1.0:1762166791.879855:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2786 00000100:00100000:1.0:1762166791.879869:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:46699:x1847765440102528:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166791.879949:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166791.879988:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c4e5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dbd expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.880013:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.880020:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166791.880261:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.880280:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.880291:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000001:00080000:1.0:1762166791.880353:0:7432:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968963 00000004:00010000:1.0:1762166791.880378:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000092464f10 reply state 0000000057380e1e transno 4294968964 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.880390:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.880417:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.880420:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166791.880424:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166791.880606:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46699:x1847765440102528:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 740us (981us total) trans 4294968964 rc 0/0 00000100:00100000:1.0:1762166791.880615:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2786 00000020:00080000:1.0:1762166791.880622:0:7432:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166791.882381:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.882467:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440102656 00000100:00100000:2.0:1762166791.882510:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440102656 00000100:00100000:2.0:1762166791.882569:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1007 00000100:00100000:2.0:1762166791.882581:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+6:46699:x1847765440102656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166791.882601:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166791.882626:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7dd2 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166791.882657:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x45:0x0] initial LVB size: 1048576, mtime: 0x69088808, atime: 0x0, ctime: 0x69088808, blocks: 0x800 00010000:00010000:2.0:1762166791.882682:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.882684:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.882694:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 7 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.882711:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 7 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.882744:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a5800, rc 0) 00000100:00100000:2.0:1762166791.882799:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+7:46699:x1847765440102656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 220us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166791.882807:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1007 00000100:00100000:3.0:1762166791.883941:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.884005:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440102784 00000100:00100000:2.0:1762166791.884013:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440102784 00000100:00100000:2.0:1762166791.884061:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1008 00000100:00100000:2.0:1762166791.884070:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+7:46699:x1847765440102784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166791.884084:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166791.884101:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7dd9 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166791.884120:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x46:0x0] initial LVB size: 3145728, mtime: 0x69088808, atime: 0x0, ctime: 0x69088808, blocks: 0x1000 00010000:00010000:2.0:1762166791.884135:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.884137:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.884143:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 8 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.884156:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 8 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.884166:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a4c00, rc 0) 00000100:00100000:2.0:1762166791.884212:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+8:46699:x1847765440102784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 142us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166791.884221:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1008 00000100:00100000:0.0:1762166791.885411:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.885496:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440102912 00000100:00100000:2.0:1762166791.885506:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440102912 00002000:00010000:2.0:1762166791.885546:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/70 (3145728->18446744073709551615) 00002000:00100000:2.0:1762166791.885552:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b480 with x1847765440102912 ext(3145728->18446744073709551615) 00002000:00010000:2.0:1762166791.885564:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2b480. 00000100:00100000:2.0:1762166791.885598:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 473 00000100:00100000:2.0:1762166791.885608:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440102912:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166791.885771:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1762166791.885774:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166791.885776:0:16567:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166791.885777:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166791.885779:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1762166791.885829:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440102912:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 221us (427us total) trans 17179869367 rc 0/0 00000100:00100000:2.0:1762166791.885836:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 473 00002000:00010000:2.0:1762166791.885840:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/70 (3145728->18446744073709551615) 00002000:00100000:2.0:1762166791.885843:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b480 with x1847765440102912 ext(3145728->18446744073709551615) 00002000:00010000:2.0:1762166791.885848:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2b480. 00000100:00100000:1.0:1762166791.887467:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.887530:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440103168 00000100:00100000:0.0:1762166791.887537:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440103168 00000100:00100000:0.0:1762166791.887577:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2787 00000100:00100000:0.0:1762166791.887587:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46699:x1847765440103168:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166791.887682:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.887707:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.887716:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:0.0:1762166791.887781:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a0b65cdd reply state 0000000041ac83b5 transno 4294968965 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.887790:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.887795:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.887797:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166791.887799:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166791.887857:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:46699:x1847765440103168:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 273us (392us total) trans 4294968965 rc 0/0 00000100:00100000:0.0:1762166791.887862:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2787 00000100:00100000:3.0:1762166791.888849:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.888908:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440103296 00000100:00100000:2.0:1762166791.888915:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440103296 00000100:00100000:2.0:1762166791.888957:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1009 00000100:00100000:2.0:1762166791.888965:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:46699:x1847765440103296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166791.888977:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166791.888989:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7de0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.889025:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 16 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166791.889033:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.889035:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166791.889040:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 16 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.889106:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 16 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166791.889120:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00000100:00100000:2.0:1762166791.889134:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446826368:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166791.889214:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166791.890204:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446826368:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166791.890226:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 16 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.890239:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a4400, rc 0) 00000100:00100000:1.0:1762166791.890274:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:46699:x1847765440103296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1310us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.890281:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1009 00000100:00100000:1.0:1762166791.890511:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.890556:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440103424 00000100:00100000:3.0:1762166791.890561:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440103424 00010000:00010000:3.0:1762166791.890595:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00000100:00100000:3.0:1762166791.890627:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 654 00000100:00100000:3.0:1762166791.890636:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440103424:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166791.890646:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166791.890663:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:3.0:1762166791.890683:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:3.0:1762166791.890704:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c4ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dc4 expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:3.0:1762166791.890716:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.890718:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.890723:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.890733:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.890757:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166791.890767:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446826496:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166791.890808:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.891985:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.892180:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446826496:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166791.892197:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166791.892237:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440103424:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1602us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.892247:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 654 00000100:00100000:1.0:1762166791.892328:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440103552 00000100:00100000:1.0:1762166791.892334:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440103552 00000100:00100000:1.0:1762166791.892380:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1010 00000100:00100000:1.0:1762166791.892387:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:46699:x1847765440103552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166791.892397:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166791.892407:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7de7 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.892434:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 16 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166791.892439:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166791.892440:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166791.892443:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 16 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.892463:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 16 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166791.892494:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00000100:00100000:1.0:1762166791.892508:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446826624:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166791.892550:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166791.893780:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446826624:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166791.893816:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 16 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.893836:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14a00, rc 0) 00000100:00100000:1.0:1762166791.893938:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:46699:x1847765440103552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1549us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.893948:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1010 00000100:00100000:2.0:1762166791.893979:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.894057:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440103680 00000100:00100000:3.0:1762166791.894067:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440103680 00010000:00010000:3.0:1762166791.894144:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00000100:00100000:3.0:1762166791.894201:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 655 00000100:00100000:3.0:1762166791.894220:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440103680:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166791.894237:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166791.894265:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:3.0:1762166791.894279:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:3.0:1762166791.894306:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c4f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dcb expref: 16 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:3.0:1762166791.894318:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.894320:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.894327:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.894349:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.894390:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166791.894405:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446826752:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166791.894470:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166791.895891:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446826752:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166791.895913:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166791.896096:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440103680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1876us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.896111:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 655 00000100:00100000:2.0:1762166791.896147:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.896279:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440103936 00000100:00100000:1.0:1762166791.896289:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440103936 00000100:00100000:0.0:1762166791.896349:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.896365:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440103808 00000100:00100000:1.0:1762166791.896372:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440103808 00000100:00100000:2.0:1762166791.896388:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1011 00000100:00100000:2.0:1762166791.896399:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440103936:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166791.896414:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1012 00000100:00100000:1.0:1762166791.896420:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440103808:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166791.896578:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1762166791.896578:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1762166791.896583:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb mtime from disk: 1762166791 -> 1762166791 00002000:00010000:1.0:1762166791.896583:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb mtime from disk: 1762166791 -> 1762166791 00002000:00010000:2.0:1762166791.896587:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb atime from disk: 1762166791 -> 1762166791 00002000:00010000:1.0:1762166791.896587:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb atime from disk: 0 -> 1762166791 00002000:00010000:1.0:1762166791.896590:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb ctime from disk: 1762166791 -> 1762166792 00002000:00010000:2.0:1762166791.896591:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb ctime from disk: 1762166791 -> 1762166792 00002000:00010000:2.0:1762166791.896595:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1762166791.896595:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1762166791.896648:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440103936:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 250us (509us total) trans 21474836686 rc 0/0 00000100:00100000:1.0:1762166791.896648:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440103808:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 227us (313us total) trans 21474836685 rc 0/0 00000100:00100000:2.0:1762166791.896657:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1011 00000100:00100000:1.0:1762166791.896662:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1012 00000100:00100000:2.0:1762166791.898253:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.898351:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440104192 00000100:00100000:1.0:1762166791.898364:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440104192 00000100:00100000:1.0:1762166791.898419:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 809 00000100:00100000:1.0:1762166791.898431:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:46699:x1847765440104192:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166791.898547:0:6498:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7daf expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.898619:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.898638:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.898649:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.898715:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.898732:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 28 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166791.898752:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446826880:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166791.898860:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166791.900208:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446826880:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166791.900235:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166791.900568:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.900687:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440104320 00000100:00100000:0.0:1762166791.900702:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440104320 00010000:00010000:0.0:1762166791.900747:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 29 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166791.900791:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 656 00000100:00100000:0.0:1762166791.900818:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440104320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166791.900837:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166791.900844:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 29 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166791.900859:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 29 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166791.900884:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c4d7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7db6 expref: 29 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166791.900902:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.900907:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166791.900918:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166791.900926:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166791.900961:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166791.900991:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.901002:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:0.0:1762166791.901030:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440104320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 214us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.901039:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 656 00000040:00080000:1.0:1762166791.901400:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].119, 88 off17800 00000004:00080000:1.0:1762166791.901414:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411049935200ns, next at 402887219919ns, rc = 0 00000040:00080000:1.0:1762166791.901445:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].120, 88 off17888 00000004:00080000:1.0:1762166791.901451:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411049972801ns, next at 402887219919ns, rc = 0 00000040:00080000:1.0:1762166791.901502:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].112, 88 off17232 00000004:00080000:1.0:1762166791.901513:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411050035185ns, next at 401651240703ns, rc = 0 00000040:00080000:1.0:1762166791.901550:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].113, 88 off17320 00000004:00080000:1.0:1762166791.901555:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411050077814ns, next at 401651240703ns, rc = 0 00000001:00080000:2.0:1762166791.902858:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968966 is committed 00000004:00080000:2.0:1762166791.902868:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 103 committed 00000004:00080000:2.0:1762166791.902884:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 102 committed 00000004:00080000:2.0:1762166791.902888:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 112 committed 00010000:00010000:0.0:1762166791.902891:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.902901:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000004:00080000:2.0:1762166791.902904:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 111 committed 00010000:00010000:0.0:1762166791.902935:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.902942:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.902948:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.902958:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.902983:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.902989:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166791.902995:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166791.902999:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446827008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166791.903002:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446827136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166791.903019:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446827392:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166791.903022:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c516 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.903043:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.903060:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.903068:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.903074:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.903080:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.903087:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166791.903095:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166791.903098:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446827264:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166791.903133:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.903137:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166791.903143:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166791.903157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166791.903167:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c52b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166791.903171:0:6498:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003b13774f reply state 000000003609d5d9 transno 4294968966 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.903194:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.903205:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00000100:00100000:3.0:1762166791.903206:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446827136 00010000:00010000:1.0:1762166791.903211:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166791.903215:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446827136 00000100:00100000:1.0:1762166791.903218:0:6498:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166791.903224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166791.903230:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.903235:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166791.903248:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c4b4 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7daf expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166791.903275:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446827264 00000100:00100000:0.0:1762166791.903284:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446827264 00000100:00100000:3.0:1762166791.903308:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446827008 00000100:00100000:3.0:1762166791.903314:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446827008 00000100:00100000:0.0:1762166791.903367:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1762166791.903385:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00010000:00080000:1.0:1762166791.903389:0:6498:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166791.903396:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765446827136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166791.903407:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1762166791.903409:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3634:x1847765446827264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166791.903417:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:46699:x1847765440104192:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4982us (5164us total) trans 4294968966 rc 0/0 00000100:00100000:2.0:1762166791.903434:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446827008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166791.903435:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 809 00010000:00010000:1.0:1762166791.903521:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.903531:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.903539:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.903545:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.903549:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.903556:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.903582:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.903585:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166791.903589:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166791.903596:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c540 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00002000:00010000:3.0:1762166791.903632:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1762166791.903632:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1762166791.903638:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:3.0:1762166791.903640:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb mtime from disk: 1762166791 -> 1762166791 00002000:00010000:0.0:1762166791.903643:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1762166791.903645:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166791.903646:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb atime from disk: 1762166791 -> 1762166791 00002000:00010000:2.0:1762166791.903658:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:3.0:1762166791.903661:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:0.0:1762166791.903662:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb mtime from disk: 1762166791 -> 1762166791 00002000:00010000:2.0:1762166791.903663:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:3.0:1762166791.903666:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1762166791.903683:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb atime from disk: 1762166791 -> 1762166791 00002000:00010000:0.0:1762166791.903689:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:0.0:1762166791.903693:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1762166791.903735:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3634:x1847765446827264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 335us (585us total) trans 21474836687 rc 0/0 00000100:00100000:3.0:1762166791.903747:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1762166791.903749:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446827008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 315us (522us total) trans 17179869368 rc 0/0 00000100:00100000:2.0:1762166791.903760:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:1.0:1762166791.903787:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869364 gen 2 00000100:00100000:0.0:1762166791.903797:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3633:x1847765446827136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 412us (701us total) trans 21474836688 rc 0/0 00000004:00080000:1.0:1762166791.903799:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe35c00, transno 17179869361 00000004:00080000:2.0:1762166791.903811:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc2d5ca80/2, rc 0, transno 21474836687 00000100:00100000:0.0:1762166791.903818:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000004:00080000:1.0:1762166791.903820:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe36300, transno 17179869362 00000100:00100000:2.0:1762166791.903825:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446827264:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762166791.903829:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc494df80, transno 17179869363 00000004:00080000:1.0:1762166791.903844:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a08e00, transno 17179869364 00000100:00100000:1.0:1762166791.903857:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc4a0aa00 x1847765446827008/t17179869368(17179869368) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166807 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166791.903871:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762166791.903881:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a0aa00/2, rc 0, transno 17179869368 00000100:00100000:1.0:1762166791.903887:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446827008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166791.903922:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446827392 00000100:00100000:2.0:1762166791.903927:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446827392 00000100:00100000:2.0:1762166791.903993:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:2.0:1762166791.904005:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446827392:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762166791.904012:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc2d5ea00/2, rc 0, transno 21474836688 00000100:00100000:0.0:1762166791.904027:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446827136:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762166791.904067:0:10004:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 4 done 00002000:00010000:2.0:1762166791.904089:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1762166791.904095:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166791.904099:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166791.904102:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166791.904106:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1762166791.904166:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446827392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (306us total) trans 17179869369 rc 0/0 00000100:00100000:2.0:1762166791.904173:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000004:00080000:1.0:1762166791.904229:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a08a80/2, rc 0, transno 17179869369 00000100:00100000:1.0:1762166791.904237:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446827392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166791.905143:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.905218:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440104448 00000100:00100000:0.0:1762166791.905225:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440104448 00000100:00100000:0.0:1762166791.905277:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2788 00000100:00100000:0.0:1762166791.905287:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:46699:x1847765440104448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166791.905327:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.905359:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7dee expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.905416:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.905428:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.905442:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.905444:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166791.905446:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89400, rc 0) 00000100:00100000:0.0:1762166791.905548:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:46699:x1847765440104448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 260us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.905557:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2788 00000100:00100000:0.0:1762166791.907175:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.907236:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440104704 00000100:00100000:1.0:1762166791.907244:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440104704 00000100:00100000:1.0:1762166791.907290:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 810 00000100:00100000:1.0:1762166791.907300:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:46699:x1847765440104704:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166791.907590:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:46699:x1847765440104704:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 290us (421us total) trans 4294968967 rc 0/0 00000100:00100000:1.0:1762166791.907610:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 810 00000100:00100000:1.0:1762166791.914545:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.914592:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440104960 00000100:00100000:0.0:1762166791.914606:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440104960 00000100:00100000:0.0:1762166791.914677:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2789 00000100:00100000:0.0:1762166791.914690:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46700:x1847765440104960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166791.914722:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.914749:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c54e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7df5 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.914841:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.914857:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.914884:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.914897:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.914901:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.914905:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915022:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915027:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915031:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166791.915040:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:0.0:1762166791.915120:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915125:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915129:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915133:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915137:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.915145:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915151:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915161:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166791.915163:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166791.915166:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915171:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915181:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915184:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915187:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915191:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.915192:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915195:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915198:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403ab00) 00010000:00010000:0.0:1762166791.915200:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166791.915201:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915211:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c55c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.915246:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c54e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.915254:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.915261:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.915263:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166791.915265:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88400, rc 0) 00000100:00100000:0.0:1762166791.915356:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:46700:x1847765440104960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 670us (886us total) trans 4294968968 rc 0/0 00000100:00100000:0.0:1762166791.915364:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2789 00000100:00100000:2.0:1762166791.917086:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.917128:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.917165:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440105088 00000100:00100000:0.0:1762166791.917178:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440105088 00000100:00100000:3.0:1762166791.917195:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440105216 00000100:00100000:3.0:1762166791.917203:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440105216 00000100:00100000:0.0:1762166791.917243:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1017 00000100:00100000:0.0:1762166791.917258:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440105088:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166791.917265:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1018 00000100:00100000:3.0:1762166791.917281:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440105216:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166791.917316:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.917319:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.917359:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.917364:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.917372:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166791.917375:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166791.917387:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166791.917390:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166791.917395:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.917397:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.917505:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.917512:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.917537:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 18 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1762166791.917538:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 18 pid: 8380 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1762166791.917595:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446827648:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166791.917601:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446827520:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166791.917701:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166791.917702:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166791.918714:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446827520:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166791.918738:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166791.918846:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446827648:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166791.918870:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166791.918895:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.918935:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440105344 00000100:00100000:0.0:1762166791.918941:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440105344 00010000:00010000:0.0:1762166791.918963:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 19 pid: 8380 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166791.919002:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 657 00000100:00100000:0.0:1762166791.919013:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440105344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166791.919025:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166791.919045:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 19 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166791.919060:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 19 pid: 8380 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1762166791.919068:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166791.919098:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c532 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de0 expref: 19 pid: 8380 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166791.919111:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440105472 00010000:00010000:0.0:1762166791.919116:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166791.919120:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166791.919124:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166791.919129:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440105472 00010000:00010000:0.0:1762166791.919136:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.919158:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 19 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166791.919172:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166791.919196:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166791.919206:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 658 00010000:00010000:2.0:1762166791.919219:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166791.919231:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440105344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 209us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.919232:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440105472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166791.919245:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.919254:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166791.919257:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 657 00010000:00010000:1.0:1762166791.919259:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166791.919276:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.919287:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166791.919289:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 18 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166791.919293:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166791.919322:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.919324:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 18 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166791.919369:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.919377:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c539 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7de7 expref: 18 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166791.919387:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c578 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.919395:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166791.919398:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166791.919401:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166791.919411:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166791.919462:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440105088:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2206us (2379us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166791.919465:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166791.919521:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1017 00010000:00010000:0.0:1762166791.919540:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.919552:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166791.919559:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440105472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 334us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166791.919591:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 658 00010000:00010000:0.0:1762166791.919594:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.919607:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.919626:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.919634:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c7a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166791.919637:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.919645:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.919660:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.919669:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c7a00/0x2f180c4effb0c571 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166791.919740:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440105216:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2461us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.919750:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1018 00000100:00100000:3.0:1762166791.920619:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.920659:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440105728 00000100:00100000:0.0:1762166791.920666:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440105728 00000100:00100000:0.0:1762166791.920697:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2790 00000100:00100000:0.0:1762166791.920703:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:46700:x1847765440105728:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166791.920762:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166791.920780:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0c3f0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d62 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.920802:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.920805:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.920822:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.920834:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.920843:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.920849:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 5/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.920874:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.920884:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 24 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166791.920897:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446827776:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166791.920965:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.920987:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 24 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166791.920997:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446827904:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166791.921028:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166791.922051:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446827776:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166791.922065:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446827904:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166791.922085:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166791.922225:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.922272:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440105984 00000100:00100000:1.0:1762166791.922278:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440105984 00010000:00010000:1.0:1762166791.922304:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 25 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1762166791.922311:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.922359:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440105856 00000100:00100000:1.0:1762166791.922363:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440105856 00010000:00010000:1.0:1762166791.922377:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166791.922400:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 659 00000100:00100000:1.0:1762166791.922412:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 660 00000100:00100000:2.0:1762166791.922420:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440105984:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166791.922425:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440105856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166791.922442:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166791.922448:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166791.922454:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166791.922458:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166791.922469:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166791.922515:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88400/0x2f180c4effb0c563 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7df5 expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166791.922532:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.922545:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.922552:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.922556:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.922560:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166791.922570:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 25 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166791.922607:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440105856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 186us (298us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166791.922611:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c547 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dee expref: 25 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166791.922615:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 660 00010000:00010000:2.0:1762166791.922636:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166791.922641:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166791.922649:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166791.922655:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166791.922681:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.922713:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166791.922726:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440105984:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 308us (494us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166791.922732:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166791.922741:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 659 00000004:00010000:0.0:1762166791.922956:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000000eed8c8 reply state 000000000f580af3 transno 4294968969 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.922973:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.922981:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.922985:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:0.0:1762166791.922988:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166791.923045:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:46700:x1847765440105728:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2339us (2428us total) trans 4294968969 rc 0/0 00000100:00100000:0.0:1762166791.923054:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2790 00000100:00100000:3.0:1762166791.923911:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166791.923987:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440106240 00000100:00100000:1.0:1762166791.923993:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440106240 00000100:00100000:1.0:1762166791.924033:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 811 00000100:00100000:1.0:1762166791.924041:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:46700:x1847765440106240:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166791.924203:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:46700:x1847765440106240:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 159us (290us total) trans 4294968970 rc 0/0 00000100:00100000:1.0:1762166791.924211:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 811 00000100:00100000:3.0:1762166791.929192:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.929234:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440106496 00000100:00100000:0.0:1762166791.929244:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440106496 00000100:00100000:0.0:1762166791.929297:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2791 00000100:00100000:0.0:1762166791.929308:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:46701:x1847765440106496:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166791.929328:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.929353:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166791.929377:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c436 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d8c expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.929394:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166791.929398:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.929410:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c586 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7dfc expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.929546:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929565:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929577:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929591:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929598:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929603:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929652:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c59b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929659:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929666:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c59b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166791.929679:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:0.0:1762166791.929755:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929762:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929768:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929774:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929780:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.929784:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929790:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929798:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166791.929801:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166791.929804:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929809:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88c00/0x2f180c4effb0c58d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929832:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929841:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929856:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929862:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb88a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166791.929865:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929870:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929877:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403ab00) 00010000:00010000:0.0:1762166791.929879:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166791.929881:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929887:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88a00/0x2f180c4effb0c594 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.929922:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88200/0x2f180c4effb0c586 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dfc expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.929934:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c59b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dfc expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.929941:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.929943:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166791.929946:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89200, rc 0) 00000100:00100000:0.0:1762166791.930002:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46701:x1847765440106496:12345-192.168.204.38@tcp:101:dd.0 Request processed in 696us (818us total) trans 4294968971 rc 0/0 00000100:00100000:0.0:1762166791.930009:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2791 00000100:00100000:3.0:1762166791.931548:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.931582:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440106624 00000100:00100000:0.0:1762166791.931588:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440106624 00000100:00100000:0.0:1762166791.931629:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2792 00000100:00100000:0.0:1762166791.931639:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46701:x1847765440106624:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166791.931652:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.931662:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88000/0x2f180c4effb0c5a9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e03 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.931682:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0c5b0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.931691:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.931698:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.931767:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88000/0x2f180c4effb0c5a9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e03 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.931781:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0c5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e03 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.931788:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.931790:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166791.931793:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb89e00, rc 0) 00000100:00100000:0.0:1762166791.931827:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:46701:x1847765440106624:12345-192.168.204.38@tcp:101:dd.0 Request processed in 191us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.931834:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2792 00000100:00100000:3.0:1762166791.932817:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.932845:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440106880 00000100:00100000:0.0:1762166791.932854:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440106880 00000100:00100000:0.0:1762166791.932886:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2793 00000100:00100000:0.0:1762166791.932894:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:46701:x1847765440106880:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1762166791.932921:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166791.932933:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89200/0x2f180c4effb0c59b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dfc expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.932943:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.932946:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.933036:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.933043:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.933047:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000001:00080000:0.0:1762166791.933090:0:7432:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968972 00000004:00010000:0.0:1762166791.933102:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000688ce46 reply state 00000000d05521c4 transno 4294968973 ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.933110:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.933113:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.933115:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166791.933117:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166791.933167:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:46701:x1847765440106880:12345-192.168.204.38@tcp:36:dd.0 Request processed in 274us (352us total) trans 4294968973 rc 0/0 00000100:00100000:0.0:1762166791.933174:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2793 00000020:00080000:0.0:1762166791.933178:0:7432:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166791.933987:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.934020:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440107008 00000100:00100000:0.0:1762166791.934024:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440107008 00000100:00100000:0.0:1762166791.934047:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2794 00000100:00100000:0.0:1762166791.934051:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:46701:x1847765440107008:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166791.934058:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.934064:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c5be lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e0a expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.934087:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c5be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e0a expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.934097:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c5be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e0a expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.934112:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.934114:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166791.934116:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88e00, rc 0) 00000100:00100000:0.0:1762166791.934144:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:46701:x1847765440107008:12345-192.168.204.38@tcp:101:dd.0 Request processed in 92us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.934151:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2794 00000100:00100000:3.0:1762166791.934886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.934915:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440107264 00000100:00100000:0.0:1762166791.934920:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440107264 00000100:00100000:0.0:1762166791.934944:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2795 00000100:00100000:0.0:1762166791.934950:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:46701:x1847765440107264:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166791.934958:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.934960:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166791.934971:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88e00/0x2f180c4effb0c5be lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e0a expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.934993:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.934996:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166791.935003:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c5c5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e11 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.935025:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c5cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.935033:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c5cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.935053:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c5cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:0.0:1762166791.935192:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].121, 88 off17976 00000004:00080000:0.0:1762166791.935198:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411083720402ns, next at 402887219919ns, rc = 0 00000040:00080000:0.0:1762166791.935220:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].122, 88 off18064 00000004:00080000:0.0:1762166791.935224:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411083745948ns, next at 402887219919ns, rc = 0 00000040:00080000:0.0:1762166791.935239:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].114, 88 off17408 00000004:00080000:0.0:1762166791.935244:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411083765719ns, next at 401651240703ns, rc = 0 00000040:00080000:0.0:1762166791.935269:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].115, 88 off17496 00000004:00080000:0.0:1762166791.935274:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411083795753ns, next at 401651240703ns, rc = 0 00000001:00080000:2.0:1762166791.936207:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968974 is committed 00000004:00080000:2.0:1762166791.936213:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 105 committed 00000004:00080000:2.0:1762166791.936227:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 104 committed 00000004:00080000:2.0:1762166791.936230:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 114 committed 00010000:00010000:1.0:1762166791.936232:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000004:00080000:2.0:1762166791.936240:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 113 committed 00010000:00010000:1.0:1762166791.936243:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936251:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936257:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.936262:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936275:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936289:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.936292:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:1.0:1762166791.936296:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936303:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89c00/0x2f180c4effb0c57f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166791.936317:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446828032:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166791.936319:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166791.936326:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446828416:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166791.936331:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166791.936336:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446828288:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166791.936353:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936360:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bccb89000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166791.936364:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936370:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936379:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166791.936382:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166791.936387:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166791.936387:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166791.936396:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89000/0x2f180c4effb0c5b7 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166791.936414:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c5cc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e11 expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.936424:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.936427:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166791.936428:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446828032 00000100:00100000:3.0:1762166791.936432:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446828032 00000100:00100000:1.0:1762166791.936439:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166791.936447:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89400/0x2f180c4effb0c5c5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e11 expref: 22 pid: 7432 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1762166791.936455:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446828160:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166791.936465:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c5cc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e11 expref: 21 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166791.936471:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446828288 00000100:00100000:3.0:1762166791.936506:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446828288 00000100:00100000:2.0:1762166791.936520:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166791.936524:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00010000:00010000:0.0:1762166791.936532:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166791.936537:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1762166791.936538:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3636:x1847765446828032:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166791.936541:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bccb88600, rc 0) 00000100:00100000:3.0:1762166791.936551:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446828160 00000100:00100000:3.0:1762166791.936555:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446828160 00000100:00100000:0.0:1762166791.936575:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:46701:x1847765440107264:12345-192.168.204.38@tcp:101:dd.0 Request processed in 1624us (1689us total) trans 4294968974 rc 0/0 00000100:00100000:0.0:1762166791.936586:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2795 00000100:00100000:3.0:1762166791.936587:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1762166791.936599:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446828288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166791.936605:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1762166791.936617:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446828160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166791.936664:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3636:x1847765446828032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (278us total) trans 21474836689 rc 0/0 00000100:00100000:1.0:1762166791.936672:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00002000:00010000:3.0:1762166791.936693:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1762166791.936696:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1762166791.936698:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166791.936699:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166791.936702:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166791.936704:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166791.936705:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00080000:0.0:1762166791.936714:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28700/2, rc 0, transno 21474836689 00000100:00100000:0.0:1762166791.936720:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446828032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762166791.936736:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe35880/2, rc 0, transno 17179869371 00000100:00100000:2.0:1762166791.936742:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3636:x1847765446828160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (220us total) trans 17179869371 rc 0/0 00002000:00010000:3.0:1762166791.936743:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1762166791.936743:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446828160:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762166791.936749:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:3.0:1762166791.936755:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1762166791.936758:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:3.0:1762166791.936790:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765446828288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (355us total) trans 17179869370 rc 0/0 00000100:00100000:3.0:1762166791.936795:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1762166791.936813:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762166791.936827:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe37800/2, rc 0, transno 17179869370 00000100:00100000:1.0:1762166791.936835:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446828288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166791.936845:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446828416 00000100:00100000:0.0:1762166791.936849:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446828416 00000100:00100000:0.0:1762166791.936874:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1762166791.936881:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3634:x1847765446828416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166791.936952:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3634:x1847765446828416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (137us total) trans 21474836690 rc 0/0 00000100:00100000:0.0:1762166791.936959:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000004:00080000:3.0:1762166791.936977:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a29880/2, rc 0, transno 21474836690 00000100:00100000:3.0:1762166791.936984:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446828416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166791.938094:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166791.938128:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440107392 00000100:00100000:0.0:1762166791.938132:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440107392 00000100:00100000:0.0:1762166791.938160:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1023 00000100:00100000:0.0:1762166791.938165:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:46701:x1847765440107392:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166791.938177:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166791.938188:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e18 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166791.938198:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4b:0x0] initial LVB size: 2097152, mtime: 0x69088807, atime: 0x69088807, ctime: 0x69088808, blocks: 0x1000 00010000:00010000:0.0:1762166791.938207:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166791.938209:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166791.938214:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 16 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.938222:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 16 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166791.938228:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb600, rc 0) 00000100:00100000:0.0:1762166791.938252:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:46701:x1847765440107392:12345-192.168.204.38@tcp:101:dd.0 Request processed in 88us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166791.938257:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1023 00000100:00100000:0.0:1762166791.939021:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.939054:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440107520 00000100:00100000:3.0:1762166791.939059:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440107520 00000100:00100000:3.0:1762166791.939090:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1024 00000100:00100000:3.0:1762166791.939098:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:46701:x1847765440107520:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1762166791.939106:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166791.939122:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e1f expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166791.939136:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4c:0x0] initial LVB size: 3145728, mtime: 0x69088807, atime: 0x69088807, ctime: 0x69088808, blocks: 0x800 00010000:00010000:3.0:1762166791.939146:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.939148:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166791.939153:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.939165:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166791.939174:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6c00, rc 0) 00000100:00100000:3.0:1762166791.939207:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:46701:x1847765440107520:12345-192.168.204.38@tcp:101:dd.0 Request processed in 110us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166791.939214:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1024 00000100:00100000:3.0:1762166791.940240:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166791.940262:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166791.940285:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440107648 00000100:00100000:2.0:1762166791.940289:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440107648 00000100:00100000:0.0:1762166791.940299:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440107776 00000100:00100000:0.0:1762166791.940305:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440107776 00002000:00010000:2.0:1762166791.940307:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/75 (0->18446744073709551615) 00002000:00100000:2.0:1762166791.940312:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9c00 with x1847765440107648 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166791.940317:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb9c00. 00002000:00010000:0.0:1762166791.940322:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/76 (0->18446744073709551615) 00002000:00100000:0.0:1762166791.940327:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbb800 with x1847765440107776 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166791.940333:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bbb800. 00000100:00100000:2.0:1762166791.940361:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 474 00000100:00100000:0.0:1762166791.940374:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 475 00000100:00100000:2.0:1762166791.940376:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440107648:12345-192.168.204.38@tcp:10:dd.0 00000100:00100000:0.0:1762166791.940388:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440107776:12345-192.168.204.38@tcp:10:dd.0 00002000:00010000:0.0:1762166791.941591:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb size from disk: 3145728 -> 0 00002000:00010000:0.0:1762166791.941600:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb mtime from disk: 1762166791 -> 1762166792 00002000:00010000:0.0:1762166791.941603:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb atime from disk: 1762166791 -> 1762166791 00002000:00010000:0.0:1762166791.941606:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:0.0:1762166791.941608:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:0.0:1762166791.941646:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440107776:12345-192.168.204.38@tcp:10:dd.0 Request processed in 1261us (1380us total) trans 21474836691 rc 0/0 00000100:00100000:0.0:1762166791.941656:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 475 00002000:00010000:0.0:1762166791.941660:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/76 (0->18446744073709551615) 00002000:00100000:0.0:1762166791.941663:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbb800 with x1847765440107776 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166791.941668:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bbb800. 00002000:00010000:2.0:1762166791.942260:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:2.0:1762166791.942264:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb mtime from disk: 1762166791 -> 1762166792 00002000:00010000:2.0:1762166791.942266:0:16567:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb atime from disk: 1762166791 -> 1762166791 00002000:00010000:2.0:1762166791.942269:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166791.942271:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 4096 -> 0 00000100:00100000:2.0:1762166791.942307:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440107648:12345-192.168.204.38@tcp:10:dd.0 Request processed in 1937us (2065us total) trans 21474836692 rc 0/0 00000100:00100000:2.0:1762166791.942324:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 474 00002000:00010000:2.0:1762166791.942327:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/75 (0->18446744073709551615) 00002000:00100000:2.0:1762166791.942330:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9c00 with x1847765440107648 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166791.942336:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb9c00. 00010000:00010000:3.0:1762166791.954680:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166792.001168:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.001290:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440108032 00000100:00100000:1.0:1762166792.001306:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440108032 00000100:00100000:1.0:1762166792.001392:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 812 00000100:00100000:1.0:1762166792.001406:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:46701:x1847765440108032:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:1.0:1762166792.001746:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:46701:x1847765440108032:12345-192.168.204.38@tcp:35:dd.0 Request processed in 342us (590us total) trans 4294968975 rc 0/0 00000100:00100000:1.0:1762166792.001757:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 812 00000100:00100000:3.0:1762166792.009624:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.009741:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440108160 00000100:00100000:0.0:1762166792.009756:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440108160 00000100:00100000:0.0:1762166792.009829:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2796 00000100:00100000:0.0:1762166792.009840:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:46702:x1847765440108160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.009862:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.009878:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e26 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.009940:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0c5e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.009953:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0c5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.009965:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0c5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.010009:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166792.010013:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166792.010046:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0c5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.010068:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e26 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.010087:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0c5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e26 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.010096:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.010099:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166792.010102:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb000, rc 0) 00000100:00100000:0.0:1762166792.010184:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46702:x1847765440108160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 345us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.010192:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2796 00000100:00100000:0.0:1762166792.011736:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.011828:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440108288 00000100:00100000:2.0:1762166792.011835:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440108288 00000100:00100000:2.0:1762166792.011879:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2797 00000100:00100000:2.0:1762166792.011888:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46702:x1847765440108288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.011902:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166792.011917:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5a00/0x2f180c4effb0c5ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e2d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.011971:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.011982:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.011991:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012004:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012011:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012017:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012101:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012118:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012122:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166792.012150:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:2.0:1762166792.012154:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166792.012167:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012178:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012186:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012192:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012197:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012203:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012209:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.012212:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012219:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012230:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166792.012238:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.012242:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012249:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c5f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012260:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012265:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012271:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012276:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a4a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.012278:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012284:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012292:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757a00) 00010000:00010000:2.0:1762166792.012294:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.012297:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012302:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c5fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.012351:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5a00/0x2f180c4effb0c5ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.012378:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.012385:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.012388:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166792.012390:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a5c00, rc 0) 00000100:00100000:2.0:1762166792.012438:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:46702:x1847765440108288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 551us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.012445:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2797 00000100:00100000:3.0:1762166792.014605:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.014661:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440108544 00000100:00100000:2.0:1762166792.014673:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440108544 00000100:00100000:2.0:1762166792.014731:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2798 00000100:00100000:2.0:1762166792.014743:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:46702:x1847765440108544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.014760:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166792.014776:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5000/0x2f180c4effb0c60b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e34 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.014851:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.014861:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.014866:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.014891:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.014914:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 25 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.014923:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446828544:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.015005:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166792.016320:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446828544:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166792.016353:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166792.016618:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.016679:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440108672 00000100:00100000:2.0:1762166792.016685:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440108672 00010000:00010000:2.0:1762166792.016704:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.016744:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 661 00000100:00100000:2.0:1762166792.016753:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440108672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166792.016764:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166792.016771:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.016783:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.016802:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c604 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e2d expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.016816:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.016829:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.016843:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.016850:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.016882:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166792.016923:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440108672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.016931:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 661 00010000:00010000:0.0:1762166792.017058:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.017065:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.017079:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:0.0:1762166792.017194:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5000/0x2f180c4effb0c60b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.017208:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.017215:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.017218:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166792.017227:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a5e00, rc 0) 00000100:00100000:0.0:1762166792.017260:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:46702:x1847765440108544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2520us (2671us total) trans 4294968976 rc 0/0 00000100:00100000:0.0:1762166792.017266:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2798 00000100:00100000:3.0:1762166792.018499:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.018544:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440108800 00000100:00100000:0.0:1762166792.018551:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440108800 00000100:00100000:0.0:1762166792.018590:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2799 00000100:00100000:0.0:1762166792.018601:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:46702:x1847765440108800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.018618:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.018632:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c620 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e3b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.018701:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.018711:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.018719:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.018746:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.018758:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 26 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166792.018771:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446828672:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166792.018818:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166792.019808:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446828672:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166792.019827:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166792.019967:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.020025:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440108928 00000100:00100000:1.0:1762166792.020031:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440108928 00010000:00010000:1.0:1762166792.020052:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 27 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166792.020091:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 662 00000100:00100000:1.0:1762166792.020101:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440108928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166792.020111:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166792.020117:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 27 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.020142:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 27 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.020157:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5e00/0x2f180c4effb0c612 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e34 expref: 27 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.020169:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166792.020174:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166792.020181:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166792.020187:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166792.020209:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166792.020240:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166792.020251:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440108928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (282us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166792.020251:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166792.020268:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 662 00000004:00200000:0.0:1762166792.020297:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:0.0:1762166792.020302:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166792.020320:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.020357:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c620 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.020370:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.020377:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.020380:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166792.020383:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a200, rc 0) 00000100:00100000:0.0:1762166792.020418:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:46702:x1847765440108800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1819us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.020426:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2799 00000100:00100000:3.0:1762166792.021955:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.022012:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440109184 00000100:00100000:1.0:1762166792.022019:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440109184 00000100:00100000:1.0:1762166792.022058:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 813 00000100:00100000:1.0:1762166792.022066:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:46702:x1847765440109184:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166792.022295:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:46702:x1847765440109184:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 230us (344us total) trans 4294968977 rc 0/0 00000100:00100000:1.0:1762166792.022303:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 813 00000100:00100000:3.0:1762166792.033990:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.034090:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440109440 00000100:00100000:0.0:1762166792.034100:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440109440 00000100:00100000:0.0:1762166792.034156:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2800 00000100:00100000:0.0:1762166792.034167:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46704:x1847765440109440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.034205:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.034225:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e42 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.034292:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034306:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034317:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034354:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034362:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034369:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034439:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034444:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034448:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034452:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034455:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.034462:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034467:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034489:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.034491:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.034495:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034499:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034509:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034513:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034517:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034520:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.034521:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034524:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034528:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403ab00) 00010000:00010000:0.0:1762166792.034529:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.034530:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034539:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c63c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.034564:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c62e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e42 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.034573:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.034575:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166792.034578:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e42 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.034588:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ae00, rc 0) 00000100:00100000:0.0:1762166792.034646:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46704:x1847765440109440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 481us (663us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166792.034657:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2800 00000100:00100000:3.0:1762166792.036168:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.036213:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440109568 00000100:00100000:0.0:1762166792.036219:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440109568 00000100:00100000:0.0:1762166792.036257:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2801 00000100:00100000:0.0:1762166792.036266:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46704:x1847765440109568:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166792.036306:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036316:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036324:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036347:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036360:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036367:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036409:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036422:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036429:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.036470:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:0.0:1762166792.036494:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166792.036507:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036519:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036525:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036531:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036537:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036541:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.036544:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036556:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036564:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.036567:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.036570:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036576:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036587:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036593:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036598:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036603:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.036605:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036611:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036617:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403ac00) 00010000:00010000:0.0:1762166792.036619:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.036622:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036627:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c64a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036645:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036650:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036655:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036659:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.036662:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036667:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036673:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.036675:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.036678:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.036683:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c651 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166792.036734:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46704:x1847765440109568:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 470us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.036742:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2801 00000100:00100000:3.0:1762166792.049159:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.049237:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440109824 00000100:00100000:0.0:1762166792.049250:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440109824 00000100:00100000:0.0:1762166792.049349:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2802 00000100:00100000:0.0:1762166792.049362:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46707:x1847765440109824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.049418:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.049446:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c658 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e49 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.049583:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049601:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049614:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049629:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049636:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049642:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049738:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049746:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049752:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049758:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049764:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.049776:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049784:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049798:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.049802:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.049807:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049815:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0c65f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049831:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049837:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049843:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049848:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.049851:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049857:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049864:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403ac00) 00010000:00010000:0.0:1762166792.049866:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.049869:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049884:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c666 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.049922:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c658 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e49 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.049933:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.049935:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166792.049939:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0c658 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e49 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.049946:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca600, rc 0) 00000100:00100000:0.0:1762166792.050004:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46707:x1847765440109824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 646us (862us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166792.050010:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2802 00000100:00100000:3.0:1762166792.051171:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.051215:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440109952 00000100:00100000:0.0:1762166792.051222:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440109952 00000100:00100000:0.0:1762166792.051261:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2803 00000100:00100000:0.0:1762166792.051267:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46707:x1847765440109952:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166792.051314:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051324:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051331:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051351:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051365:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051370:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051417:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051424:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051428:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.051466:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:0.0:1762166792.051470:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166792.051502:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051512:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051517:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051520:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051524:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051527:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.051530:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051541:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051549:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.051551:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.051554:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051557:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c66d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051566:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051569:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051573:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051576:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.051577:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051580:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051583:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403ab00) 00010000:00010000:0.0:1762166792.051585:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.051586:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051589:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c674 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051601:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051605:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051608:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051611:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.051612:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051615:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051619:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.051620:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.051622:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.051624:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c67b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166792.051676:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46707:x1847765440109952:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 409us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.051684:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2803 00000100:00100000:3.0:1762166792.096605:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.096682:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440110208 00000100:00100000:0.0:1762166792.096696:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440110208 00000100:00100000:0.0:1762166792.096773:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2804 00000100:00100000:0.0:1762166792.096785:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46722:x1847765440110208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.096833:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.096859:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e50 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.096949:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.096965:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.096978:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.096994:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097002:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097009:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097163:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c697 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097170:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c697 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097176:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c697 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.097185:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:0.0:1762166792.097285:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097304:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097310:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097318:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097324:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.097328:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097349:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097364:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.097367:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.097373:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097379:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0c689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097395:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097398:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097402:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097405:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.097412:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097416:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097421:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403ab00) 00010000:00010000:0.0:1762166792.097423:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.097425:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097429:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0c690 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.097465:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0c682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e50 expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.097474:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c697 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e50 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.097524:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.097526:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166792.097528:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ba00, rc 0) 00000100:00100000:0.0:1762166792.097588:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:46722:x1847765440110208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 804us (997us total) trans 4294968978 rc 0/0 00000100:00100000:0.0:1762166792.097594:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2804 00000100:00100000:3.0:1762166792.099649:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.099725:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440110336 00000100:00100000:1.0:1762166792.099744:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440110336 00000100:00100000:1.0:1762166792.099793:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 290 00000100:00100000:1.0:1762166792.099799:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440110336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166792.099812:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166792.099834:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0c697 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e50 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.099849:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:1.0:1762166792.099852:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166792.099895:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440110336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.099900:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 290 00000100:00100000:3.0:1762166792.125146:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.125228:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440110464 00000100:00100000:2.0:1762166792.125242:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440110464 00002000:00100000:2.0:1762166792.125309:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4b:0x0] (0->2097151) req@ffff945bc5f5e300 x1847765440110464/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:578/0 lens 488/0 e 0 to 0 dl 1762166803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166792.125318:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5e300 with x1847765440110464 ext(0->2097151) 00002000:00010000:2.0:1762166792.125324:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5f5e300 00000100:00100000:2.0:1762166792.125376:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 476 00000100:00100000:2.0:1762166792.125385:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440110464:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:2.0:1762166792.134827:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440110464:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 9426us (9680us total) trans 21474836693 rc 0/0 00000100:00100000:2.0:1762166792.134839:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 476 00002000:00100000:2.0:1762166792.134851:0:16567:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x4b:0x0] (0->2097151) req@ffff945bc5f5e300 x1847765440110464/t21474836693(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:578/0 lens 488/448 e 0 to 0 dl 1762166803 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166792.134860:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5e300 with x1847765440110464 ext(0->2097151) 00002000:00010000:2.0:1762166792.134865:0:16567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5f5e300 00000100:00100000:3.0:1762166792.137360:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.137419:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440110592 00000100:00100000:2.0:1762166792.137429:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440110592 00000100:00100000:2.0:1762166792.137523:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 477 00000100:00100000:2.0:1762166792.137535:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440110592:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166792.137573:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.137592:0:16567:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.137600:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166792.137603:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166792.137606:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.137641:0:16567:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.137655:0:16567:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 21 pid: 8382 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.137668:0:16567:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:16567:1847765446828800:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.137772:0:16567:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166792.138050:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.138099:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440110720 00000100:00100000:0.0:1762166792.138104:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440110720 00002000:00100000:0.0:1762166792.138130:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x4c:0x0] (2097152->3145727) req@ffff945cf7839180 x1847765440110720/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:578/0 lens 488/0 e 0 to 0 dl 1762166803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166792.138156:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839180 with x1847765440110720 ext(2097152->3145727) 00002000:00010000:0.0:1762166792.138160:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7839180 00000100:00100000:0.0:1762166792.138185:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 478 00000100:00100000:0.0:1762166792.138194:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440110720:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:2.0:1762166792.138857:0:16567:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:16567:1847765446828800:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166792.138877:0:16567:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.139708:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.139782:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440110848 00000100:00100000:1.0:1762166792.139793:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440110848 00010000:00010000:1.0:1762166792.139848:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 24 pid: 8382 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166792.139890:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 663 00000100:00100000:1.0:1762166792.139903:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440110848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166792.139921:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1762166792.139946:0:6480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1762166792.139950:0:6480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:1.0:1762166792.139958:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 24 pid: 8382 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.139973:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 24 pid: 8382 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.140030:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0c5d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e18 expref: 24 pid: 8382 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.140053:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.140056:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.140061:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.140072:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.140108:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166792.140140:0:16567:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.140160:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.140170:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440110848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 266us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.140185:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 663 00000100:00100000:1.0:1762166792.144018:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440110720:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5811us (5955us total) trans 21474836694 rc 0/0 00000100:00100000:1.0:1762166792.144035:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 478 00002000:00100000:1.0:1762166792.144052:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x4c:0x0] (2097152->3145727) req@ffff945cf7839180 x1847765440110720/t21474836694(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:578/0 lens 488/448 e 0 to 0 dl 1762166803 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166792.144063:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839180 with x1847765440110720 ext(2097152->3145727) 00002000:00010000:1.0:1762166792.144071:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7839180 00010000:00010000:2.0:1762166792.145453:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.145470:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.145506:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.145513:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a5c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166792.145518:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.145527:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.145546:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.145554:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a5c00/0x2f180c4effb0c6a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.145634:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440110592:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 8098us (8275us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1762166792.145645:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 477 00000100:00100000:3.0:1762166792.146634:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.146677:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440110976 00000100:00100000:2.0:1762166792.146690:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440110976 00000100:00100000:2.0:1762166792.146757:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 479 00000100:00100000:2.0:1762166792.146773:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765440110976:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166792.146816:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.146838:0:16567:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 22 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.146848:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166792.146850:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166792.146854:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.146898:0:16567:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 22 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.146914:0:16567:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 22 pid: 8382 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.146929:0:16567:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:16567:1847765446828928:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.147003:0:16567:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166792.147859:0:16567:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:16567:1847765446828928:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166792.147880:0:16567:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.149036:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.149173:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440111104 00000100:00100000:1.0:1762166792.149181:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440111104 00010000:00010000:1.0:1762166792.149212:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 23 pid: 8382 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166792.149263:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 664 00000100:00100000:1.0:1762166792.149273:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440111104:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166792.149288:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1762166792.149302:0:6480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1762166792.149306:0:6480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1762166792.149312:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 23 pid: 8382 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.149324:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 23 pid: 8382 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.149359:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6c00/0x2f180c4effb0c5da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e1f expref: 23 pid: 8382 timeout: 511 lvb_type: 0 00010000:00010000:1.0:1762166792.149372:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.149374:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.149378:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.149387:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.149416:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166792.149439:0:16567:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.149450:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.149455:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440111104:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.149474:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 664 00010000:00010000:2.0:1762166792.152635:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.152650:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.152659:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.152666:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a4a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166792.152671:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.152679:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.152696:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.152703:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4a00/0x2f180c4effb0c6ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.152796:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765440110976:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 6025us (6167us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1762166792.152805:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 479 00000100:00100000:2.0:1762166792.155190:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.155216:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.155272:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440111232 00000100:00100000:3.0:1762166792.155279:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440111360 00000100:00100000:3.0:1762166792.155294:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440111360 00000100:00100000:1.0:1762166792.155296:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440111232 00000100:00100000:3.0:1762166792.155368:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1025 00000100:00100000:3.0:1762166792.155380:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765440111360:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166792.155397:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1026 00010000:00010000:3.0:1762166792.155401:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166792.155416:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765440111232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166792.155423:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e5e expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.155435:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1762166792.155447:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4c:0x0] initial LVB size: 3145728, mtime: 0x69088808, atime: 0x69088807, ctime: 0x69088808, blocks: 0x800 00010000:00010000:1.0:1762166792.155453:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e57 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.155468:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.155471:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1762166792.155502:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4b:0x0] initial LVB size: 2097152, mtime: 0x69088808, atime: 0x69088807, ctime: 0x69088808, blocks: 0x1000 00010000:00010000:3.0:1762166792.155518:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 24 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166792.155523:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.155527:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.155540:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 24 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.155546:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 24 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166792.155565:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 24 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.155570:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c6400, rc 0) 00010000:00010000:1.0:1762166792.155579:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14a00, rc 0) 00000100:00100000:1.0:1762166792.155632:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765440111232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 224us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.155641:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765440111360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 258us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.155653:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1026 00000100:00100000:3.0:1762166792.155666:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1025 00000100:00100000:0.0:1762166792.173043:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.173118:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440111616 00000100:00100000:1.0:1762166792.173129:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440111616 00000100:00100000:1.0:1762166792.173189:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 814 00000100:00100000:1.0:1762166792.173200:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:46722:x1847765440111616:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166792.173455:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:46722:x1847765440111616:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 257us (422us total) trans 4294968979 rc 0/0 00000100:00100000:1.0:1762166792.173461:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 814 00000100:00100000:2.0:1762166792.186950:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.187109:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440111872 00000100:00100000:0.0:1762166792.187121:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440111872 00000100:00100000:0.0:1762166792.187189:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2805 00000100:00100000:0.0:1762166792.187200:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:46725:x1847765440111872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.187230:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.187253:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e65 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.187376:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c6c8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.187392:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c6c8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.187403:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c6c8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.187413:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:0.0:1762166792.187542:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e65 expref: 31 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.187559:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c6c8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e65 expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.187585:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.187588:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166792.187592:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7200, rc 0) 00000100:00100000:0.0:1762166792.187652:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:46725:x1847765440111872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 454us (715us total) trans 4294968980 rc 0/0 00000100:00100000:0.0:1762166792.187660:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2805 00000100:00100000:2.0:1762166792.214997:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.215155:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440112000 00000100:00100000:1.0:1762166792.215166:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440112000 00000100:00100000:1.0:1762166792.215246:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 480 00000100:00100000:1.0:1762166792.215256:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440112000:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166792.215292:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.215316:0:16567:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 9 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.215324:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166792.215327:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166792.215330:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.215389:0:16567:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 9 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.215403:0:16567:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 9 pid: 8380 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166792.215418:0:16567:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16567:1847765446829056:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166792.215577:0:16567:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166792.215687:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.215784:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440112128 00000100:00100000:0.0:1762166792.215799:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440112128 00000100:00100000:0.0:1762166792.215896:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 481 00000100:00100000:0.0:1762166792.215909:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440112128:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166792.215950:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.215969:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 10 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.215977:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166792.215979:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166792.215982:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.216018:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 10 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.216031:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 10 pid: 8380 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166792.216078:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446829184:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166792.216167:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166792.217984:0:16567:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16567:1847765446829056:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.217991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166792.218035:0:16567:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.218111:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.218131:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440112256 00000100:00100000:0.0:1762166792.218142:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440112256 00000100:00100000:3.0:1762166792.218146:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446829184:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166792.218175:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.218190:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 11 pid: 8380 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166792.218239:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440112384 00000100:00100000:0.0:1762166792.218245:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440112384 00000100:00100000:3.0:1762166792.218266:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 665 00010000:00010000:0.0:1762166792.218267:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 12 pid: 8380 timeout: 511 lvb_type: 0 00000100:00100000:3.0:1762166792.218284:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440112256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166792.218300:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166792.218307:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 666 00000100:00100000:0.0:1762166792.218329:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440112384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166792.218347:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 12 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166792.218348:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166792.218366:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 12 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166792.218373:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 12 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166792.218389:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 12 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1762166792.218396:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bca7a5800/0x2f180c4effb0c51d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd2 expref: 12 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166792.218407:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bca7a4c00/0x2f180c4effb0c524 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7dd9 expref: 11 pid: 8380 timeout: 511 lvb_type: 0 00010000:00010000:3.0:1762166792.218412:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.218416:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.218421:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.218421:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.218431:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.218435:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.218440:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.218450:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.218520:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166792.218525:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.218530:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166792.218538:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.218542:0:16567:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.218557:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.218576:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440112256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 295us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.218577:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440112384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 260us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.218592:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 665 00000100:00100000:0.0:1762166792.218599:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 666 00010000:00010000:1.0:1762166792.225392:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.225411:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.225418:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.225423:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166792.225426:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.225431:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.225447:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.225454:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945d00f14000/0x2f180c4effb0c6d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.225568:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440112000:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 10309us (10647us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166792.225578:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 480 00010000:00010000:3.0:1762166792.228300:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.228329:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.228348:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.228356:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166792.228360:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.228368:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.228385:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.228392:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7600/0x2f180c4effb0c6dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.228498:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+7:2418:x1847765440112128:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 12568us (12786us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1762166792.228519:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 481 00000100:00100000:2.0:1762166792.232750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.232797:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.232870:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440112512 00000100:00100000:3.0:1762166792.232880:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440112512 00000100:00100000:3.0:1762166792.232945:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440112640 00000100:00100000:3.0:1762166792.232949:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440112640 00000100:00100000:3.0:1762166792.233105:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1027 00000100:00100000:0.0:1762166792.233115:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1028 00000100:00100000:3.0:1762166792.233118:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440112512:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166792.233132:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440112640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166792.233142:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.233143:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166792.233168:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e6c expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.233168:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e73 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166792.233204:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x45:0x0] initial LVB size: 1048576, mtime: 0x69088808, atime: 0x0, ctime: 0x69088808, blocks: 0x800 00002000:00010000:0.0:1762166792.233204:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x46:0x0] initial LVB size: 3145728, mtime: 0x69088808, atime: 0x0, ctime: 0x69088808, blocks: 0x1000 00010000:00010000:3.0:1762166792.233229:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.233229:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.233234:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.233234:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.233249:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.233250:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 10 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166792.233283:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.233284:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 10 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.233311:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2a00, rc 0) 00010000:00010000:0.0:1762166792.233311:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7a00, rc 0) 00000100:00100000:0.0:1762166792.233383:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440112640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 255us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.233387:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440112512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 266us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.233395:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1027 00000100:00100000:0.0:1762166792.233406:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1028 00000100:00100000:0.0:1762166792.258638:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.258712:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440112768 00000100:00100000:2.0:1762166792.258723:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440112768 00000100:00100000:2.0:1762166792.258787:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2806 00000100:00100000:2.0:1762166792.258803:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:46727:x1847765440112768:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166792.258880:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.258897:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.258931:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.258947:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.258955:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.258961:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259026:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259033:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259037:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166792.259069:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:2.0:1762166792.259073:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166792.259085:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259097:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259103:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259109:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259125:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259130:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a4600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.259134:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259141:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259153:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166792.259156:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.259161:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259176:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4600/0x2f180c4effb0c6f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259193:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259200:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259206:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259211:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a5200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.259214:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259220:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259238:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757a00) 00010000:00010000:2.0:1762166792.259241:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.259244:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259250:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c6f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259264:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259269:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259275:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259280:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.259282:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259287:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259295:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.259297:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.259300:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.259305:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c700 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166792.259395:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:46727:x1847765440112768:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 599us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.259406:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2806 00000100:00100000:2.0:1762166792.267396:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.267465:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440113024 00000100:00100000:0.0:1762166792.267500:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440113024 00000100:00100000:0.0:1762166792.267558:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2807 00000100:00100000:0.0:1762166792.267570:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:46728:x1847765440113024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.267592:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.267611:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c707 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e7a expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.267712:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c70e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.267726:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c70e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.267737:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c70e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.267748:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:0.0:1762166792.267855:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c707 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e7a expref: 33 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.267873:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c70e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e7a expref: 32 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.267882:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.267885:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166792.267888:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b6e00, rc 0) 00000100:00100000:0.0:1762166792.267955:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:46728:x1847765440113024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 388us (568us total) trans 4294968981 rc 0/0 00000100:00100000:0.0:1762166792.267963:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2807 00000100:00100000:0.0:1762166792.270356:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.270412:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440113152 00000100:00100000:3.0:1762166792.270418:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440113152 00000100:00100000:3.0:1762166792.270456:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 291 00000100:00100000:3.0:1762166792.270471:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:46728:x1847765440113152:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:3.0:1762166792.270511:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166792.270529:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c70e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e7a expref: 32 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.270542:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166792.270546:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166792.270642:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:46728:x1847765440113152:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 170us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.270651:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 291 00000100:00100000:3.0:1762166792.271828:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.271892:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440113408 00000100:00100000:1.0:1762166792.271900:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440113408 00000100:00100000:1.0:1762166792.271943:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 815 00000100:00100000:1.0:1762166792.271952:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:46728:x1847765440113408:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166792.272109:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:46728:x1847765440113408:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 157us (293us total) trans 4294968982 rc 0/0 00000100:00100000:1.0:1762166792.272118:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 815 00000100:00100000:0.0:1762166792.274275:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.274349:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440113664 00000100:00100000:2.0:1762166792.274355:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440113664 00000100:00100000:2.0:1762166792.274392:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2808 00000100:00100000:2.0:1762166792.274400:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:46728:x1847765440113664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.274416:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166792.274431:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c71c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e81 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.274543:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.274557:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 33 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.274565:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.274594:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 33 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.274606:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 33 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.274619:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446829312:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.274703:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166792.275416:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446829312:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166792.275433:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166792.275723:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.275771:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440113792 00000100:00100000:2.0:1762166792.275776:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440113792 00010000:00010000:2.0:1762166792.275794:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 34 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.275823:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 667 00000100:00100000:2.0:1762166792.275832:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765440113792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166792.275841:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166792.275847:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 34 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.275855:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 34 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.275868:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0c627 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e3b expref: 34 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.275878:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.275880:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.275886:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.275897:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.275914:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166792.275943:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765440113792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 111us (218us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166792.275949:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166792.275953:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 667 00010000:00010000:0.0:1762166792.275962:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.275975:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:0.0:1762166792.276063:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5600/0x2f180c4effb0c71c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.276076:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 33 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.276084:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.276086:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166792.276088:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a5200, rc 0) 00000100:00100000:0.0:1762166792.276123:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:46728:x1847765440113664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1724us (1850us total) trans 4294968983 rc 0/0 00000100:00100000:0.0:1762166792.276130:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2808 00000100:00100000:0.0:1762166792.277232:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.277281:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440113920 00000100:00100000:2.0:1762166792.277286:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440113920 00000100:00100000:2.0:1762166792.277322:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2809 00000100:00100000:2.0:1762166792.277342:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:46728:x1847765440113920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.277357:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166792.277367:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c731 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e88 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.277422:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.277434:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.277441:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.277461:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.277471:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 34 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.277521:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446829440:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.277573:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166792.278316:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446829440:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166792.278342:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166792.278560:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.278600:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440114048 00000100:00100000:2.0:1762166792.278606:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440114048 00010000:00010000:2.0:1762166792.278625:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 35 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.278655:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 668 00000100:00100000:2.0:1762166792.278670:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765440114048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166792.278681:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166792.278686:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 35 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.278696:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 35 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.278710:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c723 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e81 expref: 35 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.278721:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.278726:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.278733:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.278739:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.278766:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166792.278784:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.278792:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166792.278803:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765440114048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 139us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.278812:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 668 00000004:00200000:0.0:1762166792.278819:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:0.0:1762166792.278825:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166792.278840:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.278863:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4400/0x2f180c4effb0c731 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e88 expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.278878:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e88 expref: 33 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.278885:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.278888:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166792.278890:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a4800, rc 0) 00000100:00100000:0.0:1762166792.278924:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:46728:x1847765440113920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1594us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.278932:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2809 00000100:00100000:0.0:1762166792.280130:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.280189:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440114304 00000100:00100000:1.0:1762166792.280195:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440114304 00000100:00100000:1.0:1762166792.280235:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 816 00000100:00100000:1.0:1762166792.280244:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:46728:x1847765440114304:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166792.280377:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:46728:x1847765440114304:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 134us (256us total) trans 4294968984 rc 0/0 00000100:00100000:1.0:1762166792.280385:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 816 00000100:00100000:2.0:1762166792.281201:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.281238:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440114560 00000100:00100000:0.0:1762166792.281243:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440114560 00000100:00100000:0.0:1762166792.281277:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2810 00000100:00100000:0.0:1762166792.281286:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:46728:x1847765440114560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.281303:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.281306:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166792.281320:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c6c8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e65 expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.281343:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.281347:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166792.281356:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c73f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e8f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.281409:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c746 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.281418:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c746 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.281426:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c746 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.281434:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:0.0:1762166792.281513:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c73f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e8f expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.281527:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c746 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e8f expref: 35 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.281534:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.281536:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166792.281539:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7400, rc 0) 00000100:00100000:0.0:1762166792.281573:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:46728:x1847765440114560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 288us (371us total) trans 4294968985 rc 0/0 00000100:00100000:0.0:1762166792.281587:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2810 00000100:00100000:3.0:1762166792.282585:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.282631:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440114688 00000100:00100000:1.0:1762166792.282637:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440114688 00000100:00100000:1.0:1762166792.282679:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1029 00000100:00100000:3.0:1762166792.282684:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.282693:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440114688:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166792.282712:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440114816 00000100:00100000:0.0:1762166792.282718:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440114816 00010000:00010000:1.0:1762166792.282725:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.282752:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 24 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166792.282759:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.282763:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166792.282763:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1030 00010000:00010000:1.0:1762166792.282767:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.282776:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440114816:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166792.282796:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.282802:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 24 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166792.282812:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 24 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166792.282820:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 24 pid: 8380 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.282823:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.282827:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.282831:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.282840:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446829568:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166792.282858:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 24 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166792.282869:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 24 pid: 8382 timeout: 511 lvb_type: 1 00000100:00100000:0.0:1762166792.282880:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446829696:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166792.282891:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166792.282926:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166792.283807:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446829568:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166792.283825:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.283839:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446829696:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166792.283856:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.284521:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.284567:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440114944 00000100:00100000:3.0:1762166792.284575:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.284576:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440114944 00010000:00010000:2.0:1762166792.284602:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 25 pid: 8380 timeout: 511 lvb_type: 1 00000100:00100000:2.0:1762166792.284637:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440115072 00000100:00100000:2.0:1762166792.284640:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440115072 00010000:00010000:2.0:1762166792.284652:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 26 pid: 8382 timeout: 511 lvb_type: 1 00000100:00100000:0.0:1762166792.284698:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 669 00000100:00100000:0.0:1762166792.284709:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440114944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166792.284750:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 670 00010000:00010000:0.0:1762166792.284750:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166792.284761:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440115072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166792.284770:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166792.284777:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 26 pid: 8380 timeout: 511 lvb_type: 1 00010000:00010000:2.0:1762166792.284783:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 26 pid: 8382 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.284804:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 26 pid: 8380 timeout: 511 lvb_type: 1 00010000:00010000:2.0:1762166792.284806:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 26 pid: 8382 timeout: 511 lvb_type: 1 00010000:00010000:2.0:1762166792.284843:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c6400/0x2f180c4effb0c6b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e5e expref: 26 pid: 8382 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.284845:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c6ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e57 expref: 26 pid: 8380 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.284866:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.284870:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.284874:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.284876:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166792.284880:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166792.284885:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.284888:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.284898:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.284922:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166792.284944:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166792.284956:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.284964:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440114944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 254us (483us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166792.284974:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.284980:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440115072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 215us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.284992:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 669 00010000:00010000:3.0:1762166792.284996:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.285008:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 670 00010000:00010000:3.0:1762166792.285036:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.285041:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.285054:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.285068:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.285088:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.285094:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.285111:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166792.285112:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.285124:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.285125:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166792.285136:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.285144:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.285161:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.285164:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.285174:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c754 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.285177:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.285240:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c75b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.285241:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440114688:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2549us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.285270:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1029 00000100:00100000:3.0:1762166792.285443:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440114816:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2667us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.285456:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1030 00000100:00100000:0.0:1762166792.286752:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.286813:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440115328 00000100:00100000:2.0:1762166792.286821:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440115328 00000100:00100000:2.0:1762166792.286882:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2811 00000100:00100000:2.0:1762166792.286893:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:46728:x1847765440115328:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166792.286953:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166792.286973:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb88600/0x2f180c4effb0c5cc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e11 expref: 35 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.286990:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c738 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e88 expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.286999:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.287003:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166792.287034:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.287065:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.287076:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:2.0:1762166792.287360:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].123, 88 off18152 00000004:00080000:2.0:1762166792.287372:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411435893518ns, next at 402887219919ns, rc = 0 00000040:00080000:2.0:1762166792.287398:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].124, 88 off18240 00000004:00080000:2.0:1762166792.287403:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411435925508ns, next at 402887219919ns, rc = 0 00000040:00080000:2.0:1762166792.287430:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].116, 88 off17584 00000004:00080000:2.0:1762166792.287437:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411435959322ns, next at 401651240703ns, rc = 0 00000040:00080000:2.0:1762166792.287463:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].117, 88 off17672 00000004:00080000:2.0:1762166792.287468:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411435990262ns, next at 401651240703ns, rc = 0 00000001:00080000:3.0:1762166792.288632:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968986 is committed 00000004:00080000:3.0:1762166792.288642:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 107 committed 00000004:00080000:3.0:1762166792.288658:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 106 committed 00000004:00080000:3.0:1762166792.288661:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 116 committed 00000004:00080000:3.0:1762166792.288669:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 115 committed 00000100:00100000:3.0:1762166792.288761:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446829824:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1762166792.288770:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002947bb19 reply state 00000000db7601cc transno 4294968986 ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166792.288788:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446830080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166792.288792:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446829952:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762166792.288793:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.288807:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.288812:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166792.288816:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166792.288838:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166792.288861:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166792.288893:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446830208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166792.288905:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446829824 00000100:00100000:3.0:1762166792.288912:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446829824 00010000:00080000:2.0:1762166792.288918:0:7432:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166792.288930:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166792.288931:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446830080 00000100:00100000:1.0:1762166792.288938:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446830080 00000100:00080000:3.0:1762166792.288940:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166792.288943:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46728:x1847765440115328:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2047us (2193us total) trans 4294968986 rc 0/0 00000100:00100000:2.0:1762166792.288955:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2811 00010000:00010000:0.0:1762166792.288988:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166792.288990:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446830208 00000100:00100000:3.0:1762166792.288995:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446830208 00010000:00010000:0.0:1762166792.289000:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166792.289005:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1762166792.289016:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00010000:00010000:0.0:1762166792.289017:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.289027:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca7a4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.289032:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166792.289036:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3635:x1847765446829824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166792.289040:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1762166792.289042:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3633:x1847765446830080:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166792.289044:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166792.289055:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765446830208:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166792.289063:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.289069:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166792.289075:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.289082:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a4200/0x2f180c4effb0c762 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166792.289118:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166792.289148:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446829952 00000100:00100000:0.0:1762166792.289152:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446829952 00000100:00100000:0.0:1762166792.289183:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00002000:00010000:3.0:1762166792.289186:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1762166792.289189:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1762166792.289191:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00000100:00100000:0.0:1762166792.289195:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3636:x1847765446829952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762166792.289197:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166792.289201:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:1.0:1762166792.289203:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:3.0:1762166792.289205:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb blocks from disk: 4096 -> 4096 00002000:00010000:1.0:1762166792.289210:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166792.289214:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00000100:00100000:2.0:1762166792.289219:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3633:x1847765446830080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (357us total) trans 21474836695 rc 0/0 00002000:00010000:1.0:1762166792.289220:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1762166792.289232:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1762166792.289244:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3634:x1847765446830208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (315us total) trans 17179869372 rc 0/0 00000100:00100000:3.0:1762166792.289251:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1762166792.289273:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3635:x1847765446829824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (436us total) trans 17179869373 rc 0/0 00000100:00100000:1.0:1762166792.289283:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1762166792.289313:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3636:x1847765446829952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (193us total) trans 21474836696 rc 0/0 00000100:00100000:0.0:1762166792.289328:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000004:00080000:3.0:1762166792.289348:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd0000/2, rc 0, transno 21474836696 00000004:00080000:1.0:1762166792.289350:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd1c00/2, rc 0, transno 21474836695 00000100:00100000:3.0:1762166792.289355:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446829952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166792.289360:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446830080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762166792.289391:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a0a680/2, rc 0, transno 17179869372 00000100:00100000:0.0:1762166792.289398:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446830208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762166792.289411:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a0b480/2, rc 0, transno 17179869373 00000100:00100000:1.0:1762166792.289418:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446829824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166792.290624:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.290679:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440115456 00000100:00100000:2.0:1762166792.290689:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440115456 00000100:00100000:2.0:1762166792.290740:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2812 00000100:00100000:2.0:1762166792.290750:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:46728:x1847765440115456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.290774:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166792.290794:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e96 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.290864:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.290880:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.290898:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.290901:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166792.290903:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a5200, rc 0) 00000100:00100000:2.0:1762166792.290951:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46728:x1847765440115456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 201us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.290958:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2812 00000100:00100000:2.0:1762166792.292600:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.292661:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440115584 00000100:00100000:3.0:1762166792.292668:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440115584 00000100:00100000:3.0:1762166792.292698:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2813 00000100:00100000:3.0:1762166792.292705:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46728:x1847765440115584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166792.292713:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166792.292722:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c770 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7e9d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.292800:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c777 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.292808:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c777 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.292815:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c777 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166792.292835:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:3.0:1762166792.292848:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166792.292861:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c777 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.292878:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c770 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e9d expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.292889:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c777 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e9d expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.292894:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166792.292896:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166792.292898:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3a00, rc 0) 00000100:00100000:3.0:1762166792.292928:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:46728:x1847765440115584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 224us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.292935:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2813 00000100:00100000:0.0:1762166792.294471:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.294554:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.294591:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440115712 00000100:00100000:2.0:1762166792.294600:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440115712 00000100:00100000:1.0:1762166792.294625:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440115840 00000100:00100000:1.0:1762166792.294632:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440115840 00000100:00100000:2.0:1762166792.294649:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1035 00000100:00100000:2.0:1762166792.294658:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440115712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.294680:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166792.294697:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1036 00010000:00010000:2.0:1762166792.294699:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ea4 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.294714:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440115840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166792.294728:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1762166792.294743:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4b:0x0] initial LVB size: 2097152, mtime: 0x69088808, atime: 0x69088807, ctime: 0x69088808, blocks: 0x1000 00010000:00010000:1.0:1762166792.294745:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7eab expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166792.294763:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4c:0x0] initial LVB size: 3145728, mtime: 0x69088808, atime: 0x69088807, ctime: 0x69088808, blocks: 0x800 00010000:00010000:2.0:1762166792.294766:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166792.294771:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166792.294784:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166792.294786:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.294790:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.294799:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 24 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166792.294809:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166792.294818:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 24 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166792.294827:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca7a4800, rc 0) 00010000:00010000:1.0:1762166792.294828:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14000, rc 0) 00000100:00100000:1.0:1762166792.294889:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440115840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 183us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.294890:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440115712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 232us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.294906:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1036 00000100:00100000:2.0:1762166792.294914:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1035 00000100:00100000:0.0:1762166792.319935:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.319987:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.320027:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440115968 00000100:00100000:2.0:1762166792.320042:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440115968 00000100:00100000:1.0:1762166792.320065:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440116096 00000100:00100000:1.0:1762166792.320072:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440116096 00000100:00100000:2.0:1762166792.320119:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1037 00000100:00100000:1.0:1762166792.320129:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1038 00000100:00100000:2.0:1762166792.320136:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765440115968:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166792.320144:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765440116096:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166792.320287:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765440116096:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 148us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.320289:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765440115968:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 158us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.320301:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1038 00000100:00100000:2.0:1762166792.320308:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1037 00000100:00100000:3.0:1762166792.321913:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.321956:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.321992:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440116224 00000100:00100000:2.0:1762166792.322002:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440116224 00000100:00100000:2.0:1762166792.322058:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440116352 00000100:00100000:2.0:1762166792.322079:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440116352 00000100:00100000:1.0:1762166792.322121:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1039 00000100:00100000:2.0:1762166792.322137:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1040 00000100:00100000:1.0:1762166792.322153:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440116224:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166792.322171:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440116352:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166792.322304:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440116352:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166792.322322:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1040 00000100:00100000:1.0:1762166792.322323:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440116224:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 178us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.322349:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1039 00000100:00100000:0.0:1762166792.325081:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.325139:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.325225:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440116480 00000100:00100000:1.0:1762166792.325226:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440116608 00000100:00100000:3.0:1762166792.325245:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440116480 00000100:00100000:1.0:1762166792.325245:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440116608 00000100:00100000:1.0:1762166792.325362:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 482 00000100:00100000:1.0:1762166792.325375:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765440116608:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166792.325380:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 483 00000100:00100000:3.0:1762166792.325397:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765440116480:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166792.325442:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.325442:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.325522:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.325523:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.325527:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.325528:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.325537:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.325537:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.325579:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.325587:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.331899:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.331931:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.331942:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.331949:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166792.331954:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.331964:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.332007:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.332015:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c793 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.332436:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440116608:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 6737us (6969us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166792.332450:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 482 00010000:00010000:3.0:1762166792.333191:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.333202:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.333208:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.333214:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166792.333217:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.333224:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.333234:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.333240:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c78c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.333461:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765440116480:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 8069us (8399us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1762166792.333469:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 483 00000100:00100000:2.0:1762166792.338101:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.338181:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440116736 00000100:00100000:3.0:1762166792.338193:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440116736 00000100:00100000:3.0:1762166792.338262:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 484 00000100:00100000:3.0:1762166792.338271:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440116736:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166792.338305:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.338343:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 9 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.338351:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.338353:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.338357:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.338394:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 9 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.338409:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 9 pid: 8382 timeout: 511 lvb_type: 1 00000100:00100000:3.0:1762166792.338424:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446830336:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166792.338537:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166792.339688:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446830336:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166792.339710:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.339837:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.339880:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440116864 00000100:00100000:0.0:1762166792.339886:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440116864 00010000:00010000:0.0:1762166792.339922:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 10 pid: 8382 timeout: 511 lvb_type: 1 00000100:00100000:0.0:1762166792.339955:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 671 00000100:00100000:0.0:1762166792.339965:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440116864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166792.339975:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166792.340001:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 10 pid: 8382 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.340013:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 10 pid: 8382 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.340035:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0c6e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e6c expref: 10 pid: 8382 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.340079:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.340081:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.340086:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.340095:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.340119:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166792.340133:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.340146:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.340161:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440116864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 196us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.340168:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 671 00000001:00080000:2.0:1762166792.344736:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869374 is committed 00000001:00080000:2.0:1762166792.344751:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869373 is committed 00010000:00010000:3.0:1762166792.344854:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.344868:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.344877:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.344884:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166792.344889:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.344898:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.344914:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.344922:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c79a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.344995:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+7:2417:x1847765440116736:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 6723us (6902us total) trans 17179869374 rc 0/0 00000100:00100000:3.0:1762166792.345003:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 484 00000100:00100000:1.0:1762166792.349248:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.349293:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440116992 00000100:00100000:3.0:1762166792.349304:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440116992 00000100:00100000:3.0:1762166792.349381:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 485 00000100:00100000:3.0:1762166792.349392:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+7:2417:x1847765440116992:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166792.349424:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.349442:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 7 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.349450:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.349452:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.349456:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.349516:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 7 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.349527:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 7 pid: 8383 timeout: 511 lvb_type: 1 00000100:00100000:3.0:1762166792.349540:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446830464:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.349670:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166792.350593:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446830464:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166792.350610:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.350834:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.350950:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440117120 00000100:00100000:0.0:1762166792.350955:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440117120 00010000:00010000:0.0:1762166792.350976:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 8 pid: 8383 timeout: 511 lvb_type: 1 00000100:00100000:0.0:1762166792.351004:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 672 00000100:00100000:0.0:1762166792.351011:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440117120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166792.351021:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166792.351041:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 8 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.351081:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 8 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.351104:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c6eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e73 expref: 8 pid: 8383 timeout: 511 lvb_type: 1 00010000:00010000:0.0:1762166792.351124:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.351128:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.351132:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.351141:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.351165:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166792.351201:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+7:2418:x1847765440117120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 189us (368us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166792.351208:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.351213:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 672 00010000:00010000:2.0:1762166792.351223:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166792.358165:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869375 is committed 00010000:00010000:2.0:1762166792.358315:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.358339:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.358348:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.358355:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166792.358360:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.358376:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.358394:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.358403:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e2200/0x2f180c4effb0c7a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.358523:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2417:x1847765440116992:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 9129us (9280us total) trans 17179869375 rc 0/0 00000100:00100000:2.0:1762166792.358534:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 485 00000100:00100000:2.0:1762166792.367523:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.367588:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440117376 00000100:00100000:3.0:1762166792.367599:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440117376 00000100:00100000:3.0:1762166792.367663:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2814 00000100:00100000:3.0:1762166792.367675:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:46728:x1847765440117376:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166792.367755:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166792.367790:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c777 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e9d expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.367809:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166792.367827:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166792.368061:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.368077:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.368089:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000001:00080000:3.0:1762166792.368141:0:7432:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294968987 00000004:00010000:3.0:1762166792.368164:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001a8f3bc4 reply state 000000001d9917be transno 4294968988 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.368175:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.368181:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166792.368184:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166792.368186:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166792.368288:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46728:x1847765440117376:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 615us (774us total) trans 4294968988 rc 0/0 00000100:00100000:3.0:1762166792.368296:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2814 00000020:00080000:3.0:1762166792.368301:0:7432:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166792.370034:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.370122:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440117504 00000100:00100000:0.0:1762166792.370131:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440117504 00000100:00100000:0.0:1762166792.370182:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1041 00000100:00100000:0.0:1762166792.370191:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+6:46728:x1847765440117504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.370204:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.370220:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7eb2 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166792.370258:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x45:0x0] initial LVB size: 1048576, mtime: 0x69088808, atime: 0x0, ctime: 0x69088808, blocks: 0x800 00010000:00010000:0.0:1762166792.370279:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.370282:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.370291:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 7 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.370306:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 7 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.370318:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7a00, rc 0) 00000100:00100000:0.0:1762166792.370372:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+7:46728:x1847765440117504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 183us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.370379:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1041 00000100:00100000:1.0:1762166792.371611:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.371673:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440117632 00000100:00100000:0.0:1762166792.371678:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440117632 00000100:00100000:0.0:1762166792.371701:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1042 00000100:00100000:0.0:1762166792.371706:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+7:46728:x1847765440117632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166792.371714:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166792.371722:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7eb9 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166792.371742:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x46:0x0] initial LVB size: 3145728, mtime: 0x69088808, atime: 0x0, ctime: 0x69088808, blocks: 0x1000 00010000:00010000:0.0:1762166792.371757:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.371759:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.371765:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.371791:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.371801:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b6800, rc 0) 00000100:00100000:0.0:1762166792.371835:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+8:46728:x1847765440117632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 125us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.371842:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1042 00000100:00100000:2.0:1762166792.372948:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.373017:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440117760 00000100:00100000:0.0:1762166792.373027:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440117760 00002000:00010000:0.0:1762166792.373070:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/70 (3145728->18446744073709551615) 00002000:00100000:0.0:1762166792.373075:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc58cdc00 with x1847765440117760 ext(3145728->18446744073709551615) 00002000:00010000:0.0:1762166792.373087:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc58cdc00. 00000100:00100000:0.0:1762166792.373128:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 486 00000100:00100000:0.0:1762166792.373138:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440117760:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166792.373354:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1762166792.373358:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:0.0:1762166792.373361:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166792.373364:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:0.0:1762166792.373366:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1762166792.373429:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440117760:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 292us (490us total) trans 17179869376 rc 0/0 00000100:00100000:0.0:1762166792.373438:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 486 00002000:00010000:0.0:1762166792.373442:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/70 (3145728->18446744073709551615) 00002000:00100000:0.0:1762166792.373445:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc58cdc00 with x1847765440117760 ext(3145728->18446744073709551615) 00002000:00010000:0.0:1762166792.373464:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc58cdc00. 00000100:00100000:1.0:1762166792.374861:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.374958:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440118016 00000100:00100000:3.0:1762166792.374970:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440118016 00000100:00100000:3.0:1762166792.375037:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2815 00000100:00100000:3.0:1762166792.375062:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46728:x1847765440118016:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166792.375199:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.375220:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.375233:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:3.0:1762166792.375369:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000109cc3b2 reply state 0000000011dc52c4 transno 4294968989 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.375383:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.375392:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166792.375395:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166792.375399:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166792.375557:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:46728:x1847765440118016:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 496us (701us total) trans 4294968989 rc 0/0 00000100:00100000:3.0:1762166792.375566:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2815 00000100:00100000:1.0:1762166792.377202:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.377243:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.377283:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440118272 00000100:00100000:0.0:1762166792.377292:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440118144 00000100:00100000:2.0:1762166792.377295:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440118272 00000100:00100000:0.0:1762166792.377297:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440118144 00000100:00100000:2.0:1762166792.377390:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1043 00000100:00100000:2.0:1762166792.377403:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440118144:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166792.377413:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1044 00000100:00100000:1.0:1762166792.377427:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440118272:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166792.377584:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1762166792.377585:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1762166792.377592:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:1.0:1762166792.377593:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166792.377597:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb atime from disk: 1762166791 -> 1762166792 00002000:00010000:1.0:1762166792.377598:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb atime from disk: 1762166791 -> 1762166792 00002000:00010000:2.0:1762166792.377601:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:1.0:1762166792.377604:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:2.0:1762166792.377605:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 4096 -> 4096 00002000:00010000:1.0:1762166792.377611:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1762166792.377668:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440118272:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 247us (473us total) trans 21474836697 rc 0/0 00000100:00100000:2.0:1762166792.377672:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440118144:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 270us (426us total) trans 21474836698 rc 0/0 00000100:00100000:1.0:1762166792.377700:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1044 00000100:00100000:2.0:1762166792.377706:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1043 00000100:00100000:2.0:1762166792.378864:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.378933:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440118528 00000100:00100000:1.0:1762166792.378940:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440118528 00000100:00100000:1.0:1762166792.378988:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 817 00000100:00100000:1.0:1762166792.378999:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:46728:x1847765440118528:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166792.379082:0:6498:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c746 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e8f expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.379138:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166792.379154:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.379164:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166792.379202:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166792.379215:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 28 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:1.0:1762166792.379230:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446830592:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166792.379339:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166792.380673:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446830592:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166792.380697:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166792.380854:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.380928:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440118656 00000100:00100000:0.0:1762166792.380943:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440118656 00010000:00010000:0.0:1762166792.380993:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 29 pid: 7432 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166792.381098:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 673 00000100:00100000:0.0:1762166792.381114:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440118656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166792.381461:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166792.381470:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 29 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166792.381513:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 29 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166792.381543:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca7a5200/0x2f180c4effb0c769 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e96 expref: 29 pid: 7432 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166792.381565:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.381570:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166792.381580:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166792.381587:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166792.381622:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166792.381659:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166792.381669:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:0.0:1762166792.381702:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440118656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 592us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.381712:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 673 00000040:00080000:1.0:1762166792.381993:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].125, 88 off18328 00000004:00080000:1.0:1762166792.382006:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411530527030ns, next at 402887219919ns, rc = 0 00000040:00080000:1.0:1762166792.382034:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].126, 88 off18416 00000004:00080000:1.0:1762166792.382039:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411530560913ns, next at 402887219919ns, rc = 0 00000040:00080000:1.0:1762166792.382066:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].118, 88 off17760 00000004:00080000:1.0:1762166792.382071:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411530593374ns, next at 401651240703ns, rc = 0 00000040:00080000:1.0:1762166792.382105:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].119, 88 off17848 00000004:00080000:1.0:1762166792.382110:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411530632383ns, next at 401651240703ns, rc = 0 00000001:00080000:3.0:1762166792.384878:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968990 is committed 00000004:00080000:3.0:1762166792.384898:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 109 committed 00000004:00080000:3.0:1762166792.384924:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 108 committed 00000004:00080000:3.0:1762166792.384927:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 118 committed 00000004:00080000:3.0:1762166792.384949:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 117 committed 00010000:00010000:0.0:1762166792.385051:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385063:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385071:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385078:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.385085:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385095:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385116:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.385122:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.385127:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385147:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0c7a8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385179:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385186:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385197:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166792.385222:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446830976:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166792.385222:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.385228:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385236:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385246:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.385249:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.385252:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.385259:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7bd lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166792.385271:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446831104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166792.385298:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166792.385363:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446830720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166792.385375:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446830976 00000100:00100000:2.0:1762166792.385378:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166792.385387:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446830976 00000100:00100000:1.0:1762166792.385415:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446831104 00000100:00100000:1.0:1762166792.385422:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446831104 00000100:00100000:3.0:1762166792.385435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166792.385458:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446830720 00000100:00100000:0.0:1762166792.385465:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446830720 00000100:00100000:1.0:1762166792.385509:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1762166792.385520:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166792.385526:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3633:x1847765446830976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166792.385534:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446830848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166792.385538:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1762166792.385555:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446831104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166792.385583:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1762166792.385587:0:6498:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001ce2e710 reply state 000000006b42bea5 transno 4294968990 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166792.385617:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166792.385626:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446830848 00010000:00010000:2.0:1762166792.385631:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00000100:00100000:3.0:1762166792.385633:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446830848 00010000:00010000:2.0:1762166792.385645:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166792.385651:0:6498:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166792.385662:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00010000:00010000:2.0:1762166792.385666:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.385671:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:3.0:1762166792.385678:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3636:x1847765446830720:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762166792.385688:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c746 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e8f expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166792.385703:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1762166792.385704:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1762166792.385712:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:0.0:1762166792.385713:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:1.0:1762166792.385720:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb atime from disk: 1762166792 -> 1762166792 00002000:00010000:0.0:1762166792.385721:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166792.385730:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:0.0:1762166792.385730:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:1.0:1762166792.385738:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4c:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1762166792.385738:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x46:0x0] updating lvb blocks from disk: 4096 -> 4096 00002000:00010000:3.0:1762166792.385767:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1762166792.385773:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00002000:00010000:3.0:1762166792.385777:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb atime from disk: 1762166792 -> 1762166792 00002000:00010000:3.0:1762166792.385781:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00002000:00010000:3.0:1762166792.385784:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4b:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1762166792.385804:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3633:x1847765446830976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 284us (506us total) trans 21474836699 rc 0/0 00000100:00100000:1.0:1762166792.385823:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1762166792.385847:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1762166792.385851:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446831104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 303us (475us total) trans 17179869377 rc 0/0 00000100:00100000:1.0:1762166792.385859:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446830848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166792.385864:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00010000:00080000:2.0:1762166792.385870:0:6498:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762166792.385879:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3636:x1847765446830720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (442us total) trans 21474836700 rc 0/0 00000100:00100000:3.0:1762166792.385891:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1762166792.385901:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:46728:x1847765440118528:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6898us (7036us total) trans 4294968990 rc 0/0 00000100:00100000:2.0:1762166792.385915:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 817 00002000:00010000:1.0:1762166792.385958:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1762166792.385963:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869373 gen 2 00002000:00010000:1.0:1762166792.385964:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb mtime from disk: 1762166792 -> 1762166792 00000004:00080000:3.0:1762166792.385969:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc58cca80/2, rc 0, transno 21474836700 00002000:00010000:1.0:1762166792.385970:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:0.0:1762166792.385971:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a0aa00, transno 17179869368 00002000:00010000:1.0:1762166792.385978:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb ctime from disk: 1762166792 -> 1762166792 00000100:00100000:3.0:1762166792.385981:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446830720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762166792.385986:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a08a80, transno 17179869369 00002000:00010000:1.0:1762166792.385988:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x45:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00080000:0.0:1762166792.385997:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe37800, transno 17179869370 00000004:00080000:0.0:1762166792.386006:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe35880, transno 17179869371 00000004:00080000:0.0:1762166792.386015:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a0a680, transno 17179869372 00000004:00080000:0.0:1762166792.386020:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a0b480, transno 17179869373 00000100:00100000:0.0:1762166792.386037:0:3634:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc4532300 x1847765446831104/t17179869377(17179869377) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166808 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166792.386047:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4532300/2, rc 0, transno 17179869377 00000100:00100000:1.0:1762166792.386049:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446830848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (463us total) trans 17179869378 rc 0/0 00000100:00100000:0.0:1762166792.386057:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446831104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166792.386064:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00010000:00010000:2.0:1762166792.386070:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166792.386082:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166792.386091:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00000004:00080000:3.0:1762166792.386096:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc58cf480/2, rc 0, transno 21474836699 00000100:00100000:3.0:1762166792.386103:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446830976:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762166792.386124:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.386131:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166792.386140:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00000004:00080000:3.0:1762166792.386142:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4533800/2, rc 0, transno 17179869378 00000100:00100000:3.0:1762166792.386155:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446830848:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166792.386161:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.386167:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166792.386171:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166792.386177:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c7c4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00000004:00080000:2.0:1762166792.386417:0:10004:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 0 in flight, 6 done 00000100:00100000:2.0:1762166792.388558:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.388640:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440118784 00000100:00100000:3.0:1762166792.388658:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440118784 00000100:00100000:3.0:1762166792.388713:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2816 00000100:00100000:3.0:1762166792.388720:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:46728:x1847765440118784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166792.388745:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166792.388771:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0c7cb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ec0 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.388868:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0c7cb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ec0 expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.388885:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0c7cb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ec0 expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.388905:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:3.0:1762166792.388908:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166792.388912:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2800, rc 0) 00000100:00100000:3.0:1762166792.388988:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:46728:x1847765440118784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 267us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.388996:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2816 00000100:00100000:2.0:1762166792.390746:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.390843:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440119040 00000100:00100000:1.0:1762166792.390854:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440119040 00000100:00100000:1.0:1762166792.390920:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 818 00000100:00100000:1.0:1762166792.390932:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:46728:x1847765440119040:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166792.391229:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:46728:x1847765440119040:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 299us (492us total) trans 4294968991 rc 0/0 00000100:00100000:1.0:1762166792.391239:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 818 00000100:00100000:2.0:1762166792.401904:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166792.402002:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440119296 00000100:00100000:3.0:1762166792.402015:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440119296 00000100:00100000:3.0:1762166792.402099:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2817 00000100:00100000:3.0:1762166792.402112:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46730:x1847765440119296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166792.402147:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166792.402179:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c7d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ec7 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.402276:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402292:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402306:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402357:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402365:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402371:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402555:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402563:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402570:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402580:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402587:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166792.402592:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402600:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402613:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166792.402617:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166792.402622:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402629:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2c00/0x2f180c4effb0c7d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402653:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402659:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402665:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402671:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166792.402674:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402681:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402688:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc580a700) 00010000:00010000:3.0:1762166792.402691:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166792.402694:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402699:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0c7e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166792.402734:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c7d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ec7 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.402742:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166792.402743:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166792.402746:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c7d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ec7 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.402761:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3c00, rc 0) 00000100:00100000:2.0:1762166792.402904:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46730:x1847765440119296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 793us (1010us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166792.402919:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2817 00000100:00100000:2.0:1762166792.404248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.404324:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440119424 00000100:00100000:0.0:1762166792.404347:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440119424 00000100:00100000:0.0:1762166792.404403:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2818 00000100:00100000:0.0:1762166792.404412:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46730:x1847765440119424:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166792.404509:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404525:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404536:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404553:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404560:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404566:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404652:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404661:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404668:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.404714:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:0.0:1762166792.404719:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166792.404732:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404746:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404752:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404758:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404766:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404772:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.404777:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404784:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404795:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.404803:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.404808:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404815:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c7e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404829:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404835:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404841:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404846:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.404849:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404854:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404862:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403a000) 00010000:00010000:0.0:1762166792.404864:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.404867:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404872:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c7ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404887:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404892:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404905:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404910:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.404913:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404919:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404925:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.404927:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.404930:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.404935:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c7f5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166792.405007:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46730:x1847765440119424:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 596us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.405015:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2818 00000100:00100000:0.0:1762166792.418266:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.418369:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440119680 00000100:00100000:2.0:1762166792.418386:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440119680 00000100:00100000:2.0:1762166792.418519:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2819 00000100:00100000:2.0:1762166792.418535:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46733:x1847765440119680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.418568:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166792.418599:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c7fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ece expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.418739:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418760:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418776:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418793:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418800:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418807:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418945:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418954:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418960:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418966:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418972:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fdc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.418976:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.418995:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419009:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166792.419012:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.419017:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419023:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419040:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419046:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419052:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419056:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fc000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.419058:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419063:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419068:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757900) 00010000:00010000:2.0:1762166792.419070:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.419073:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419078:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c80a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.419151:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c7fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ece expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.419163:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166792.419166:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166792.419170:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c7fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ece expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.419180:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fca00, rc 0) 00000100:00100000:2.0:1762166792.419271:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46733:x1847765440119680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 739us (1022us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166792.419279:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2819 00000100:00100000:2.0:1762166792.420824:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.420928:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440119808 00000100:00100000:0.0:1762166792.420937:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440119808 00000100:00100000:0.0:1762166792.421006:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2820 00000100:00100000:0.0:1762166792.421019:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46733:x1847765440119808:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166792.421114:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421133:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421162:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421179:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421186:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421192:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421269:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421276:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421281:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.421322:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:0.0:1762166792.421326:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166792.421362:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421374:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421379:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421385:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421402:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421408:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.421412:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421425:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421438:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.421441:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.421446:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421451:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421465:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421470:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421524:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421529:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.421531:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421536:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421550:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403a000) 00010000:00010000:0.0:1762166792.421552:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.421554:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421558:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c818 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421569:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421572:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421576:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421579:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.421581:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421583:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421587:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.421588:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.421589:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.421594:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c81f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166792.421673:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46733:x1847765440119808:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 656us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.421689:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2820 00000100:00100000:0.0:1762166792.466242:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.466337:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440120064 00000100:00100000:2.0:1762166792.466353:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440120064 00000100:00100000:2.0:1762166792.466434:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2821 00000100:00100000:2.0:1762166792.466446:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:46748:x1847765440120064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.466539:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166792.466571:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ed5 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.466675:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.466693:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.466708:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.466745:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.466753:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.466761:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.466902:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0c83b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.466912:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0c83b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.466919:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0c83b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166792.466930:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:2.0:1762166792.467043:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467053:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467058:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467065:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467072:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fc000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.467077:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467100:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467113:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166792.467116:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.467121:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467127:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c82d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467143:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467148:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467153:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467158:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fdc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166792.467161:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467167:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467172:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757900) 00010000:00010000:2.0:1762166792.467175:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166792.467177:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467182:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0c834 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.467235:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ed5 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.467250:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0c83b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ed5 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.467257:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.467259:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166792.467261:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fd800, rc 0) 00000100:00100000:2.0:1762166792.467337:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:46748:x1847765440120064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 885us (1102us total) trans 4294968992 rc 0/0 00000100:00100000:2.0:1762166792.467345:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2821 00000100:00100000:2.0:1762166792.492180:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.492290:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440120192 00000100:00100000:0.0:1762166792.492300:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440120192 00000100:00100000:0.0:1762166792.492387:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 487 00000100:00100000:0.0:1762166792.492400:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440120192:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166792.492437:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.492456:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166792.492463:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.492468:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.492474:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.492542:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.492544:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440120320 00000100:00100000:2.0:1762166792.492559:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440120320 00000100:00100000:2.0:1762166792.492630:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 488 00000100:00100000:2.0:1762166792.492643:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440120320:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166792.492677:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.492691:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166792.492693:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166792.492699:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.492712:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.497792:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.497810:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.497818:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.497827:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fca00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166792.497832:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.497854:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.497879:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.497888:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fca00/0x2f180c4effb0c850 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.497987:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440120320:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 5342us (5546us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166792.498000:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 488 00010000:00010000:0.0:1762166792.499706:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.499724:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.499730:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.499735:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166792.499738:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.499743:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.499769:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.499774:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c849 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.499838:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440120192:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 7439us (7664us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1762166792.499845:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 487 00000100:00100000:3.0:1762166792.517776:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.517869:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440120576 00000100:00100000:1.0:1762166792.517883:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440120576 00000100:00100000:1.0:1762166792.517961:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 819 00000100:00100000:1.0:1762166792.517972:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:46748:x1847765440120576:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166792.518282:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:46748:x1847765440120576:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 310us (516us total) trans 4294968993 rc 0/0 00000100:00100000:1.0:1762166792.518292:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 819 00000100:00100000:1.0:1762166792.532868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166792.533010:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440120832 00000100:00100000:2.0:1762166792.533027:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440120832 00000100:00100000:2.0:1762166792.533101:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2822 00000100:00100000:2.0:1762166792.533115:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:46751:x1847765440120832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166792.533140:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166792.533160:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7edc expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.533258:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0c85e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.533269:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0c85e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166792.533278:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0c85e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166792.533286:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00010000:00010000:2.0:1762166792.533386:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0c857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7edc expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.533400:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0c85e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7edc expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.533406:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166792.533408:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166792.533410:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fde00, rc 0) 00000100:00100000:2.0:1762166792.533467:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:46751:x1847765440120832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 358us (617us total) trans 4294968994 rc 0/0 00000100:00100000:2.0:1762166792.533528:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2822 00000100:00100000:2.0:1762166792.558263:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.558340:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440120960 00000100:00100000:0.0:1762166792.558352:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440120960 00000100:00100000:0.0:1762166792.558426:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 489 00000100:00100000:0.0:1762166792.558438:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440120960:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166792.558472:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.558514:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 9 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.558520:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166792.558522:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166792.558524:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.558553:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 9 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.558579:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 9 pid: 9165 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166792.558591:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446831232:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166792.558675:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.558678:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166792.558718:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440121088 00000100:00100000:2.0:1762166792.558723:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440121088 00000100:00100000:2.0:1762166792.558776:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 490 00000100:00100000:2.0:1762166792.558785:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440121088:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166792.558802:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.558814:0:23943:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 10 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.558821:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166792.558823:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166792.558825:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.558848:0:23943:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 10 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.558858:0:23943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 10 pid: 9165 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.558868:0:23943:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:23943:1847765446831360:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.558903:0:23943:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166792.559911:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446831232:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166792.559927:0:23943:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:23943:1847765446831360:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166792.559931:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.559955:0:23943:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166792.560273:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.560310:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.560384:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440121216 00000100:00100000:0.0:1762166792.560389:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440121216 00010000:00010000:0.0:1762166792.560410:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 11 pid: 9165 timeout: 511 lvb_type: 0 00000100:00100000:2.0:1762166792.560412:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440121344 00000100:00100000:2.0:1762166792.560419:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440121344 00010000:00010000:2.0:1762166792.560440:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 12 pid: 9165 timeout: 511 lvb_type: 0 00000100:00100000:0.0:1762166792.560449:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 674 00000100:00100000:0.0:1762166792.560460:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440121216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166792.560500:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166792.560506:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 675 00000100:00100000:2.0:1762166792.560519:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440121344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166792.560524:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 12 pid: 9165 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.560530:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166792.560540:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 12 pid: 9165 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.560545:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 12 pid: 9165 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.560563:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 12 pid: 9165 timeout: 511 lvb_type: 0 00010000:00010000:0.0:1762166792.560569:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c7af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb2 expref: 12 pid: 9165 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.560581:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6800/0x2f180c4effb0c7b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eb9 expref: 12 pid: 9165 timeout: 511 lvb_type: 0 00010000:00010000:2.0:1762166792.560611:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.560611:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166792.560616:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166792.560616:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166792.560623:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.560624:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166792.560644:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.560646:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.560682:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166792.560692:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166792.560717:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.560726:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440121344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 206us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.560726:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440121216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 263us (448us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166792.560734:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.560736:0:23943:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.560744:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 674 00010000:00010000:3.0:1762166792.560758:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166792.560762:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 675 00010000:00010000:0.0:1762166792.566781:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.566800:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.566809:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.566817:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166792.566822:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.566830:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.566861:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166792.566870:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c86c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166792.567005:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440120960:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 8560us (8743us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166792.567020:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 489 00010000:00010000:3.0:1762166792.568345:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.568368:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.568377:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.568385:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fc000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166792.568389:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.568398:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.568416:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166792.568440:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c873 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [1048576->3145727] (req 1048576->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166792.568587:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+7:2418:x1847765440121088:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 9799us (9910us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1762166792.568599:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 490 00000100:00100000:2.0:1762166792.572252:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166792.572370:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440121472 00000100:00100000:1.0:1762166792.572386:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440121472 00000100:00100000:1.0:1762166792.572469:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1049 00000100:00100000:1.0:1762166792.572541:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+7:2417:x1847765440121472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166792.572568:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166792.572596:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166792.572599:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ee3 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166792.572631:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x45:0x0] initial LVB size: 1048576, mtime: 0x69088808, atime: 0x0, ctime: 0x69088808, blocks: 0x800 00010000:00010000:1.0:1762166792.572661:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.572664:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166792.572676:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 8 pid: 8380 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166792.572699:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440121600 00010000:00010000:1.0:1762166792.572699:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 8 pid: 8380 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166792.572715:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440121600 00010000:00010000:1.0:1762166792.572727:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15000, rc 0) 00000100:00100000:3.0:1762166792.572791:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1050 00000100:00100000:3.0:1762166792.572807:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2416:x1847765440121600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166792.572827:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166792.572831:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440121472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 347us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166792.572843:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1049 00010000:00010000:3.0:1762166792.572848:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7eea expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166792.572876:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x46:0x0] initial LVB size: 3145728, mtime: 0x69088808, atime: 0x0, ctime: 0x69088808, blocks: 0x1000 00010000:00010000:3.0:1762166792.572897:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.572901:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166792.572911:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 9 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.572929:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 9 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166792.572943:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3c00, rc 0) 00000100:00100000:3.0:1762166792.572991:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2416:x1847765440121600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 190us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.573014:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1050 00000100:00100000:2.0:1762166792.600674:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166792.600757:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440121728 00000100:00100000:0.0:1762166792.600779:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440121728 00000100:00100000:0.0:1762166792.600864:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2823 00000100:00100000:0.0:1762166792.600877:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:46753:x1847765440121728:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166792.600978:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601000:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601012:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601028:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601035:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601041:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601150:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601161:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601167:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166792.601216:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x9:0x0]: returning size 3145728 00000004:00200000:0.0:1762166792.601220:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166792.601233:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601247:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601254:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601260:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601267:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601274:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.601279:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601287:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601299:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166792.601310:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.601316:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601323:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601355:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601361:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601367:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601372:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.601375:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601382:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601390:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc403a300) 00010000:00010000:0.0:1762166792.601393:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.601396:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601402:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c88f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601418:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601423:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601434:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601438:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166792.601441:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601446:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601453:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:0.0:1762166792.601456:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166792.601459:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166792.601465:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0c896 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166792.601650:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:46753:x1847765440121728:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 774us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.601659:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2823 00000100:00100000:0.0:1762166792.978716:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446831488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1762166792.978747:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446831616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1762166792.978785:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166792.978850:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166792.978901:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446831488 00000100:00100000:3.0:1762166792.978927:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446831488 00000100:00100000:1.0:1762166792.978951:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166792.978996:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446831616 00000100:00100000:0.0:1762166792.979006:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446831616 00000100:00100000:3.0:1762166792.979053:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1762166792.979069:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446831488:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166792.979080:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1762166792.979095:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+18:3636:x1847765446831616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1762166792.979120:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 50847424 pending 6389760 free 3919282176 avail 3687759872 00000100:00080000:1.0:1762166792.979124:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1762166792.979124:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 50847424 pending 6389760 free 3919282176 avail 3687759872 00000100:00100000:3.0:1762166792.979195:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446831488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166792.979207:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1762166792.979208:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+18:3636:x1847765446831616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166792.979231:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1762166792.979234:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836676 gen 2 00000004:00080000:1.0:1762166792.979244:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef7100, transno 21474836676 00000100:00100000:1.0:1762166792.979285:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446831488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1762166792.979302:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446831616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1762166794.002686:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166794.002762:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446831744:0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.002795:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1847765446831872:0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.002824:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446832000:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.002860:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166794.002867:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166794.002882:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166794.002952:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446832512:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.002952:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446832256:0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.002954:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446832384:0@lo:400:kworker.0 00000100:00100000:0.0:1762166794.002973:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446831872 00000100:00100000:0.0:1762166794.002987:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446831872 00000100:00100000:1.0:1762166794.002988:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166794.002992:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166794.003017:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446832768:0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.003021:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765446832128:0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.003030:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446833024:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.003053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166794.003063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166794.003083:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446832000 00000100:00100000:0.0:1762166794.003084:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446832128 00000100:00100000:1.0:1762166794.003086:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446833280:0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.003092:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446832000 00000100:00100000:0.0:1762166794.003093:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446832128 00000100:00100000:2.0:1762166794.003098:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446832640:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.003124:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166794.003145:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166794.003162:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446833280 00000100:00100000:3.0:1762166794.003169:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446832256 00000100:00100000:0.0:1762166794.003169:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446833280 00000100:00100000:3.0:1762166794.003178:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446832256 00000100:00100000:2.0:1762166794.003181:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1847765446833152:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.003190:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446831744 00000100:00100000:1.0:1762166794.003195:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446831744 00000100:00100000:3.0:1762166794.003201:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1762166794.003210:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446832000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.003219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166794.003231:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1762166794.003243:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446833152 00000100:00100000:1.0:1762166794.003246:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765446831744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166794.003251:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446833152 00000100:00100000:3.0:1762166794.003278:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446832000:12345-0@lo:400:kworker.0 Request processed in 67us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.003289:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1762166794.003295:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765446831744:12345-0@lo:400:kworker.0 Request processed in 57us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.003315:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1847765446831872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166794.003323:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1762166794.003325:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1762166794.003325:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1762166794.003350:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765446832128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.003365:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1762166794.003383:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1762166794.003384:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:3633:x1847765446832256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.003384:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1847765446831872:12345-0@lo:400:kworker.0 Request processed in 81us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.003396:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446833280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.003399:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1762166794.003429:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1762166794.003446:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1847765446833152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.003454:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:3633:x1847765446832256:12345-0@lo:400:kworker.0 Request processed in 79us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.003454:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446833280:12345-0@lo:400:kworker.0 Request processed in 60us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166794.003465:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1762166794.003465:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1762166794.003472:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765446832128:12345-0@lo:400:kworker.0 Request processed in 127us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166794.003515:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446832768 00000100:00100000:1.0:1762166794.003515:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446832512 00000100:00100000:3.0:1762166794.003522:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446832768 00000100:00100000:1.0:1762166794.003522:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446832512 00000100:00100000:2.0:1762166794.003536:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1847765446833152:12345-0@lo:400:kworker.0 Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.003552:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1762166794.003558:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446832640 00000100:00100000:1.0:1762166794.003562:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446832640 00000100:00100000:2.0:1762166794.003610:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765446832128:0@lo:400:kworker.0 00000100:00100000:0.0:1762166794.003612:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1762166794.003636:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1847765446833152:0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.003665:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1762166794.003680:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3635:x1847765446832512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166794.003690:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1762166794.003701:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1762166794.003712:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446832768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.003724:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166794.003725:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446832640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.003730:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3635:x1847765446832512:12345-0@lo:400:kworker.0 Request processed in 47us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166794.003750:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1762166794.003770:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1847765446832896:0@lo:400:kworker.0 00000100:00100000:0.0:1762166794.003798:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446832768:12345-0@lo:400:kworker.0 Request processed in 96us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.003808:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446832640:12345-0@lo:400:kworker.0 Request processed in 94us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.003815:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1762166794.003828:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166794.003834:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1762166794.003851:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446832384 00000100:00100000:3.0:1762166794.003855:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446832384 00000100:00100000:2.0:1762166794.003879:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1847765446831872:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.003887:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446832896 00000100:00100000:1.0:1762166794.003891:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446832896 00000100:00100000:3.0:1762166794.003893:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1762166794.003899:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446832384:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1762166794.003916:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166794.003925:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1762166794.003932:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166794.003939:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00080000:0.0:1762166794.003941:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1762166794.003943:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446832384:12345-0@lo:400:kworker.0 Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.003949:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1847765446832896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.003954:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1762166794.003974:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166794.004002:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1847765446832896:12345-0@lo:400:kworker.0 Request processed in 54us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.004010:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1762166794.004014:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446832256:0@lo:400:kworker.0 00000100:00100000:3.0:1762166794.004025:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446832384:0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.004028:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446832000:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.004030:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446833024 00000100:00100000:1.0:1762166794.004035:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446833024 00000100:00100000:0.0:1762166794.004053:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446832768:0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.004060:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446832512:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.004091:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1762166794.004096:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446833280:0@lo:400:kworker.0 00000100:00100000:1.0:1762166794.004107:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446833024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166794.004149:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446831744:0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.004162:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869360 gen 2 00000100:00100000:1.0:1762166794.004162:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446833024:12345-0@lo:400:kworker.0 Request processed in 56us (191us total) trans 0 rc 0/0 00000004:00080000:2.0:1762166794.004171:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc494d180, transno 17179869360 00000100:00100000:1.0:1762166794.004176:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1762166794.004184:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1847765446832896:0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.004198:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446832640:0@lo:400:kworker.0 00000100:00080000:1.0:1762166794.004220:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166794.004266:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446833024:0@lo:400:kworker.0 00000100:00100000:2.0:1762166794.258720:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166794.258795:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440121984 00000100:00100000:3.0:1762166794.258814:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440121984 00000100:00080000:0.0:1762166794.258901:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166794.258948:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 820 00000100:00100000:3.0:1762166794.258984:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:47176:x1847765440121984:12345-192.168.204.38@tcp:35:rm.0 00000100:00100000:3.0:1762166794.259357:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:47176:x1847765440121984:12345-192.168.204.38@tcp:35:rm.0 Request processed in 379us (652us total) trans 4294968995 rc 0/0 00000100:00100000:3.0:1762166794.259367:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 820 00000100:00100000:0.0:1762166794.262284:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.262415:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440122240 00000100:00100000:2.0:1762166794.262428:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440122240 00000100:00100000:2.0:1762166794.262590:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2824 00000100:00100000:2.0:1762166794.262605:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:47176:x1847765440122240:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:2.0:1762166794.262688:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1762166794.262733:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0c85e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7edc expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.262778:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2800/0x2f180c4effb0c7cb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ec0 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.262827:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0c83b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ed5 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.262855:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89e00/0x2f180c4effb0c5b0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e03 expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.262875:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc403aa00) 00010000:00010000:2.0:1762166794.262919:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0c5e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7e26 expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.262939:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166794.262945:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166794.262984:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263001:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263014:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263042:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263051:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263074:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263206:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263224:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263235:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000040:00080000:2.0:1762166794.263716:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].127, 64 off18480 00000004:00080000:2.0:1762166794.263733:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413412254462ns, next at 414412249989ns, rc = 0 00000040:00080000:2.0:1762166794.263757:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].128, 64 off18544 00000040:00080000:2.0:1762166794.263819:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].120, 64 off17912 00000004:00080000:2.0:1762166794.263836:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413412358302ns, next at 414412353984ns, rc = 0 00000040:00080000:2.0:1762166794.263864:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].121, 64 off17976 00010000:00010000:2.0:1762166794.263960:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263973:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263983:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.263992:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264000:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264006:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264038:0:7432:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166794.264071:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264096:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264104:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264111:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166794.264118:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264130:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264151:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc4757e00) 00010000:00010000:2.0:1762166794.264155:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166794.264162:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 2/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264169:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0c8ab lrc: 0/0,0 mode: --/EX res: [0x200000405:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264441:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264453:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264458:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264465:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264472:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae5400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166794.264521:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264531:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264548:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166794.264551:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166794.264555:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264561:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5400/0x2f180c4effb0c89d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000004:00010000:2.0:1762166794.264579:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000af0d19c9 reply state 000000006f5d8313 transno 4294968996 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264589:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264599:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757200) 00010000:00010000:2.0:1762166794.264602:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166794.264607:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166794.264740:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:47176:x1847765440122240:12345-192.168.204.38@tcp:36:rm.0 Request processed in 2132us (2464us total) trans 4294968996 rc 0/0 00000100:00100000:2.0:1762166794.264751:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2824 00010000:00010000:2.0:1762166794.264806:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166794.264814:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264833:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166794.264845:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264893:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264908:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x9:0x0].0x0 (ffff945bc4757e00) 00010000:00010000:2.0:1762166794.264911:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166794.264914:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264921:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0c8b2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166794.264956:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166794.264961:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166794.264969:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166794.510117:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.510159:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.510165:0:6487:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440122368 00000100:00100000:0.0:1762166794.510177:0:6487:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440122368 00000100:00100000:2.0:1762166794.510199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.510231:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.510238:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 606 00000100:00100000:0.0:1762166794.510251:0:6487:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2419:x1847765440122368:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166794.510277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166794.510303:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440122496 00000100:00100000:1.0:1762166794.510310:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440122752 00000100:00100000:3.0:1762166794.510317:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440122496 00000100:00100000:1.0:1762166794.510318:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440122752 00000100:00100000:2.0:1762166794.510343:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440122880 00000100:00100000:2.0:1762166794.510351:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440122880 00000100:00100000:0.0:1762166794.510351:0:6487:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2419:x1847765440122368:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.510365:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 606 00000100:00100000:3.0:1762166794.510389:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440122624 00000100:00100000:3.0:1762166794.510395:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440122624 00000100:00100000:1.0:1762166794.510422:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 259 00000100:00100000:1.0:1762166794.510440:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440122752:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166794.510441:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 260 00000100:00100000:3.0:1762166794.510453:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 422 00000100:00100000:0.0:1762166794.510471:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 423 00000100:00100000:3.0:1762166794.510514:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440122496:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166794.510526:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440122880:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166794.510546:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440122624:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166794.510553:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440122752:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 118us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.510568:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 259 00000100:00100000:3.0:1762166794.510586:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440122496:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 121us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166794.510596:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 422 00000100:00080000:1.0:1762166794.510614:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166794.510615:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440122880:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 148us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.510615:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440122624:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 80us (383us total) trans 0 rc 0/0 00000100:00080000:1.0:1762166794.510628:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166794.510640:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166794.510646:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 260 00000100:00100000:0.0:1762166794.510646:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 423 00000001:02000400:2.0:1762166794.834628:0:31499:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 49a: FIEMAP upon FLR file ============= 05:46:34 (1762166794) 00000100:00100000:2.0:1762166794.864869:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.864930:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440123008 00000100:00100000:0.0:1762166794.864940:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440123008 00000100:00100000:0.0:1762166794.865000:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2825 00000100:00100000:0.0:1762166794.865011:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:47328:x1847765440123008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166794.865032:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166794.865051:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c8b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ef1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.865109:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c8c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.865130:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.865143:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:0.0:1762166794.865184:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166794.865188:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166794.865205:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.865226:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0c8b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ef1 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.865240:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ef1 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.865248:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166794.865252:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166794.865255:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7600, rc 0) 00000100:00100000:0.0:1762166794.865326:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:47328:x1847765440123008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 317us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.865341:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2825 00000100:00100000:3.0:1762166794.866906:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.867018:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440123136 00000100:00100000:0.0:1762166794.867026:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440123136 00000100:00100000:0.0:1762166794.867072:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2826 00000100:00100000:0.0:1762166794.867080:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:47328:x1847765440123136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166794.867090:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166794.867100:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c8c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ef8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.867146:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867155:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867163:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867175:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867182:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867188:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867219:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867226:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867231:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867238:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867244:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166794.867248:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867264:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867275:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166794.867278:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166794.867299:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867306:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867317:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867323:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867328:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867333:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166794.867337:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867342:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867350:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff945bc4180400) 00010000:00010000:0.0:1762166794.867352:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166794.867355:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867360:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6800/0x2f180c4effb0c8d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.867391:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c8c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ef8 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.867401:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166794.867403:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166794.867408:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0c8c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ef8 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.867417:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7c00, rc 0) 00000100:00100000:0.0:1762166794.867466:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:47328:x1847765440123136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 387us (570us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166794.867472:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2826 00000100:00100000:3.0:1762166794.870295:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.870349:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440123392 00000100:00100000:1.0:1762166794.870357:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440123392 00000100:00100000:1.0:1762166794.870405:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2827 00000100:00100000:1.0:1762166794.870414:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:47328:x1847765440123392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166794.870435:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166794.870438:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166794.870460:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7600/0x2f180c4effb0c8c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ef1 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.870498:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166794.870504:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166794.870518:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c8dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7eff expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.870608:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.870620:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.870640:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.870653:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.870660:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.870667:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.870987:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.870997:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871004:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166794.871013:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 0 00010000:00010000:1.0:1762166794.871035:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871042:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871049:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871055:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871060:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166794.871071:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871077:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871085:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166794.871088:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166794.871091:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871097:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0c8e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166794.871106:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008b6964dd reply state 0000000026874459 transno 4294968997 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871115:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.871121:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff945cd4634100) 00010000:00010000:1.0:1762166794.871124:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166794.871126:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166794.871147:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0c8dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.871159:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.871167:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945cd4634000) 00010000:00010000:1.0:1762166794.871170:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166794.871173:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15e00, rc 0) 00000100:00100000:1.0:1762166794.871228:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:47328:x1847765440123392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 815us (948us total) trans 4294968997 rc 0/0 00000100:00100000:1.0:1762166794.871241:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2827 00000100:00100000:0.0:1762166794.872654:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.872692:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440123648 00000100:00100000:1.0:1762166794.872700:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440123648 00000100:00100000:1.0:1762166794.872742:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2828 00000100:00100000:1.0:1762166794.872757:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:47328:x1847765440123648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166794.872773:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166794.872785:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c8ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f06 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.872841:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.872852:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.872861:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.872892:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.872905:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 30 pid: 6494 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1762166794.872918:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446833408:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166794.873000:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac7a240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166794.874000:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446833408:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166794.874015:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166794.874329:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.874390:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440123776 00000100:00100000:2.0:1762166794.874403:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440123776 00010000:00010000:2.0:1762166794.874445:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 31 pid: 6494 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1762166794.874525:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 676 00000100:00100000:2.0:1762166794.874534:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440123776:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166794.874547:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166794.874554:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 31 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1762166794.874565:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 31 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1762166794.874590:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c8f1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eff expref: 31 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:2.0:1762166794.874608:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945cd4634000) 00010000:00010000:2.0:1762166794.874613:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.874624:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.874631:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.874659:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166794.874686:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.874699:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166794.874713:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 0 00000100:00100000:2.0:1762166794.874720:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440123776:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 184us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.874729:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 676 00000004:00080000:1.0:1762166794.874873:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x47:0x0], index 1: 0 00000004:00080000:1.0:1762166794.874883:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4d:0x0], index 0: 0 00010000:00010000:1.0:1762166794.874961:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.874969:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.874976:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.874982:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166794.874987:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.874994:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.875009:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945cd4634000) 00010000:00010000:1.0:1762166794.875013:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166794.875017:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 2/0,0 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.875023:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0c906 lrc: 0/0,0 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.875072:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c8ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f06 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.875078:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166794.875080:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166794.875083:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0c8ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f06 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.875089:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15600, rc 0) 00000100:00100000:1.0:1762166794.875129:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:47328:x1847765440123648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2374us (2476us total) trans 4294968998 rc 301/301 00000100:00100000:1.0:1762166794.875136:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2828 00000100:00100000:0.0:1762166794.876210:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.876255:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440124032 00000100:00100000:1.0:1762166794.876263:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440124032 00000100:00100000:1.0:1762166794.876317:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 821 00000100:00100000:1.0:1762166794.876395:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:47328:x1847765440124032:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166794.876591:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:47328:x1847765440124032:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 201us (383us total) trans 4294968999 rc 0/0 00000100:00100000:1.0:1762166794.876599:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 821 00000100:00100000:0.0:1762166794.877684:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.877719:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440124288 00000100:00100000:1.0:1762166794.877725:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440124288 00000100:00100000:1.0:1762166794.877764:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 822 00000100:00100000:1.0:1762166794.877773:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:47328:x1847765440124288:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166794.877883:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:47328:x1847765440124288:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 110us (198us total) trans 4294969000 rc 0/0 00000100:00100000:1.0:1762166794.877901:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 822 00000100:00100000:0.0:1762166794.891510:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.891749:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440124416 00000100:00100000:0.0:1762166794.891761:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440124416 00000100:00100000:0.0:1762166794.891830:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2829 00000100:00100000:0.0:1762166794.891844:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:47335:x1847765440124416:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166794.891875:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166794.891896:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f0d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.891953:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c91b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.891973:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.891984:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:0.0:1762166794.892031:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166794.892035:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166794.892055:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.892074:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6200/0x2f180c4effb0c914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f0d expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.892084:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c91b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f0d expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.892090:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166794.892093:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166794.892095:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7a00, rc 0) 00000100:00100000:0.0:1762166794.892147:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:47335:x1847765440124416:12345-192.168.204.38@tcp:101:dd.0 Request processed in 307us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.892154:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2829 00000100:00100000:0.0:1762166794.893806:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.893907:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440124672 00000100:00100000:0.0:1762166794.893918:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440124672 00000100:00100000:0.0:1762166794.894003:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2830 00000100:00100000:0.0:1762166794.894017:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:47335:x1847765440124672:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166794.894046:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166794.894065:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166794.894108:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c91b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f0d expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.894129:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166794.894134:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166794.894157:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c922 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.894348:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894367:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894378:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894391:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894398:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894406:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894551:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c937 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894560:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c937 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894568:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c937 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:0.0:1762166794.894585:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 0 00010000:00010000:0.0:1762166794.894688:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894695:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894701:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894707:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894713:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166794.894718:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894726:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894734:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166794.894737:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166794.894741:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894746:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6e00/0x2f180c4effb0c929 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894759:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894764:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894779:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894783:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166794.894786:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894791:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894797:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff945cd4634100) 00010000:00010000:0.0:1762166794.894800:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166794.894802:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894807:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0c930 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.894842:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c922 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f14 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.894853:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c937 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f14 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.894860:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:0.0:1762166794.894862:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166794.894864:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7e00, rc 0) 00000100:00100000:0.0:1762166794.894933:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:47335:x1847765440124672:12345-192.168.204.38@tcp:101:dd.0 Request processed in 921us (1143us total) trans 4294969001 rc 0/0 00000100:00100000:0.0:1762166794.894942:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2830 00000100:00100000:1.0:1762166794.896326:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.896400:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440124800 00000100:00100000:0.0:1762166794.896411:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440124800 00000100:00100000:0.0:1762166794.896464:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2831 00000100:00100000:0.0:1762166794.896518:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:47335:x1847765440124800:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166794.896551:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166794.896569:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c945 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f1b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.896602:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c94c lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.896614:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c94c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.896625:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c94c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.896728:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7800/0x2f180c4effb0c945 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f1b expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.896744:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c94c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f1b expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.896754:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:0.0:1762166794.896757:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166794.896760:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b6400, rc 0) 00000100:00100000:0.0:1762166794.896821:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:47335:x1847765440124800:12345-192.168.204.38@tcp:101:dd.0 Request processed in 348us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.896830:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2831 00000100:00100000:1.0:1762166794.897898:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.897952:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440125056 00000100:00100000:0.0:1762166794.897971:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440125056 00000100:00100000:0.0:1762166794.898024:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2832 00000100:00100000:0.0:1762166794.898036:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:47335:x1847765440125056:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1762166794.898085:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166794.898108:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c937 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f14 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.898124:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:0.0:1762166794.898127:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166794.898330:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.898343:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.898352:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:0.0:1762166794.898409:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969002 00000004:00010000:0.0:1762166794.898439:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ef3e84fa reply state 00000000124fd9bf transno 4294969003 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.898452:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166794.898459:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:0.0:1762166794.898462:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166794.898465:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166794.898590:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:47335:x1847765440125056:12345-192.168.204.38@tcp:36:dd.0 Request processed in 555us (695us total) trans 4294969003 rc 0/0 00000100:00100000:0.0:1762166794.898600:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2832 00000020:00080000:0.0:1762166794.898606:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166794.899597:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.899651:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440125184 00000100:00100000:0.0:1762166794.899661:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440125184 00000100:00100000:0.0:1762166794.899722:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2833 00000100:00100000:0.0:1762166794.899738:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:47335:x1847765440125184:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166794.899758:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166794.899777:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c95a lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.899823:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c95a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f22 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.899837:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c95a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f22 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.899857:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:0.0:1762166794.899860:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166794.899864:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7200, rc 0) 00000100:00100000:0.0:1762166794.899920:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:47335:x1847765440125184:12345-192.168.204.38@tcp:101:dd.0 Request processed in 186us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.899931:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2833 00000100:00100000:0.0:1762166794.901038:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.901087:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440125440 00000100:00100000:1.0:1762166794.901097:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440125440 00000100:00100000:1.0:1762166794.901152:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2834 00000100:00100000:1.0:1762166794.901163:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:47335:x1847765440125440:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166794.901181:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166794.901184:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166794.901208:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7200/0x2f180c4effb0c95a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f22 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.901224:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166794.901228:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166794.901239:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c961 lrc: 2/0,0 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f29 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.901297:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c968 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.901309:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c968 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.901318:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c968 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000040:00080000:1.0:1762166794.901544:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].122, 88 off18064 00000004:00080000:1.0:1762166794.901552:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414050073630ns, next at 414412353984ns, rc = 0 00000040:00080000:1.0:1762166794.901607:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].129, 88 off18632 00000004:00080000:1.0:1762166794.901614:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414050135961ns, next at 414412249989ns, rc = 0 00000001:00080000:2.0:1762166794.902949:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969004 is committed 00000004:00080000:2.0:1762166794.902962:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 120 committed 00010000:00010000:1.0:1762166794.902978:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000004:00080000:2.0:1762166794.902982:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 111 committed 00010000:00010000:1.0:1762166794.902994:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166794.903002:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166794.903010:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae5e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166794.903016:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000004:00080000:2.0:1762166794.903024:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 110 committed 00010000:00010000:1.0:1762166794.903026:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000004:00080000:2.0:1762166794.903033:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 119 committed 00010000:00010000:1.0:1762166794.903050:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x995b1268 (ffff945bc4757200) 00010000:00010000:1.0:1762166794.903057:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166794.903064:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166794.903074:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0c8a4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x995b1268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166794.903104:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903112:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903117:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903135:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166794.903140:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903147:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166794.903149:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446833536:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1762166794.903164:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff945cd4634100) 00010000:00010000:1.0:1762166794.903168:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166794.903173:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166794.903176:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446833664:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166794.903183:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c8ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903204:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903210:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903216:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903220:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166794.903224:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903231:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166794.903237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166794.903242:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446833792:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1762166794.903247:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166794.903257:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166794.903260:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.903266:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7a00/0x2f180c4effb0c953 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:2.0:1762166794.903301:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446833536 00000100:00100000:2.0:1762166794.903308:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446833536 00000100:00100000:0.0:1762166794.903316:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166794.903330:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446834176:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166794.903339:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c968 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f29 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.903350:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166794.903353:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166794.903367:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166794.903375:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c961 lrc: 0/0,0 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f29 expref: 22 pid: 6494 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1762166794.903386:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446833792 00000100:00100000:2.0:1762166794.903391:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446833792 00010000:00010000:1.0:1762166794.903395:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c968 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f29 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.903421:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00000100:00100000:0.0:1762166794.903424:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446834176 00010000:00010000:1.0:1762166794.903425:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166794.903428:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:1.0:1762166794.903432:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15400, rc 0) 00000100:00100000:0.0:1762166794.903432:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446834176 00000100:00100000:3.0:1762166794.903439:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446833920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166794.903441:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1762166794.903453:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3634:x1847765446833536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762166794.903535:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:75 count 1 00010000:00010000:2.0:1762166794.903552:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166794.903557:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1762166794.903579:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3636:x1847765446833792:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166794.903583:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166794.903595:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:47335:x1847765440125440:12345-192.168.204.38@tcp:101:dd.0 Request processed in 2429us (2558us total) trans 4294969004 rc 0/0 00010000:00010000:2.0:1762166794.903603:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166794.903608:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166794.903613:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2834 00010000:00010000:2.0:1762166794.903614:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1762166794.903625:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:76 count 1 00010000:00010000:2.0:1762166794.903646:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166794.903647:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.903701:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 24 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166794.903702:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 24 pid: 9168 timeout: 514 lvb_type: 1 00010000:00010000:0.0:1762166794.903744:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.903747:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.903751:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166794.903755:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446834304:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166794.903793:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 24 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166794.903808:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 24 pid: 9165 timeout: 514 lvb_type: 1 00000100:00100000:0.0:1762166794.903823:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446834432:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166794.903860:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166794.903863:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785c000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166794.903885:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166794.903901:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446834048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166794.903927:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446833920 00000100:00100000:0.0:1762166794.903934:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446833920 00000100:00100000:3.0:1762166794.903955:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166794.903964:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446834048 00000100:00100000:0.0:1762166794.903969:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446834048 00000100:00100000:0.0:1762166794.903988:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1762166794.903995:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446834176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166794.904059:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1762166794.904073:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446833920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1762166794.904119:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:70 count 1 00010000:00010000:3.0:1762166794.904133:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.904146:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 8 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166794.904155:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166794.904157:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166794.904161:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.904188:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 8 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166794.904198:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 8 pid: 28434 timeout: 514 lvb_type: 1 00000100:00100000:3.0:1762166794.904209:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446834560:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166794.904219:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446834176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (849us total) trans 17179869379 rc 0/0 00000100:00100000:0.0:1762166794.904237:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1762166794.904249:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4480 going to sleep for 11 seconds 00000004:00080000:2.0:1762166794.904270:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dc000/2, rc 0, transno 17179869379 00000100:00100000:0.0:1762166794.904276:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1762166794.904296:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446834176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166794.904309:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3634:x1847765446834048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166794.904432:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166794.904434:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3634:x1847765446834048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (478us total) trans 21474836701 rc 0/0 00000100:00100000:0.0:1762166794.904446:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000004:00080000:2.0:1762166794.904468:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a0b480/2, rc 0, transno 21474836701 00000100:00100000:2.0:1762166794.904510:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446834048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166794.904566:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446833664 00000100:00100000:0.0:1762166794.904572:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446833664 00000100:00100000:0.0:1762166794.904606:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1762166794.904614:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3635:x1847765446833664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762166794.904627:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:69 count 1 00010000:00010000:0.0:1762166794.904640:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.904654:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 8 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166794.904661:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.904663:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.904667:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.904690:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 8 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166794.904697:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 8 pid: 8380 timeout: 514 lvb_type: 1 00000100:00100000:0.0:1762166794.904720:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446834688:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166794.904784:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee1719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166794.905028:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446834304:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166794.905049:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166794.905096:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446834432:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166794.905117:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166794.905118:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.905176:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440125568 00000100:00100000:2.0:1762166794.905183:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440125568 00000100:00100000:3.0:1762166794.905186:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446834560:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166794.905199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166794.905210:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 25 pid: 9165 timeout: 514 lvb_type: 1 00010000:00010000:3.0:1762166794.905216:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166794.905257:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440125696 00000100:00100000:2.0:1762166794.905264:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 677 00000100:00100000:0.0:1762166794.905266:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440125696 00000100:00100000:2.0:1762166794.905280:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765440125568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166794.905307:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 26 pid: 9168 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1762166794.905309:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166794.905325:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 26 pid: 9165 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1762166794.905340:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 26 pid: 9165 timeout: 514 lvb_type: 1 00000100:00100000:0.0:1762166794.905364:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 678 00010000:00010000:2.0:1762166794.905365:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c785 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eab expref: 26 pid: 9165 timeout: 514 lvb_type: 1 00000100:00100000:0.0:1762166794.905381:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440125696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166794.905384:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166794.905392:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166794.905397:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905398:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166794.905411:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 25 pid: 9168 timeout: 514 lvb_type: 1 00010000:00010000:0.0:1762166794.905437:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 25 pid: 9168 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1762166794.905441:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905458:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca7a4800/0x2f180c4effb0c77e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ea4 expref: 25 pid: 9168 timeout: 514 lvb_type: 1 00010000:00010000:0.0:1762166794.905471:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.905509:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.905514:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.905517:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166794.905527:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.905547:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905559:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166794.905563:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765440125568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 285us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.905574:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 677 00010000:00010000:1.0:1762166794.905578:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.905589:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166794.905597:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440125696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 216us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.905619:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 678 00010000:00010000:1.0:1762166794.905621:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.905632:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.905632:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166794.905645:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166794.905653:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166794.905678:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.905685:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.905701:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1762166794.905707:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166794.905714:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166794.905732:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166794.905734:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166794.905739:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905745:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905758:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905762:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4800/0x2f180c4effb0c96f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905783:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166794.905793:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905798:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166794.905802:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905807:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905821:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905828:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6a00/0x2f180c4effb0c976 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.905859:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166794.905864:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166794.905867:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166794.905888:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166794.905888:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440125824 00000100:00100000:0.0:1762166794.905896:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440125824 00010000:00010000:0.0:1762166794.905923:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 9 pid: 28434 timeout: 514 lvb_type: 1 00000100:00100000:2.0:1762166794.905941:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440126080 00000100:00100000:2.0:1762166794.905949:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440126080 00000100:00100000:0.0:1762166794.905963:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 679 00010000:00010000:2.0:1762166794.905977:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 10 pid: 8380 timeout: 514 lvb_type: 1 00000100:00100000:0.0:1762166794.905978:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440125824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166794.905997:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166794.906005:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 10 pid: 28434 timeout: 514 lvb_type: 1 00000100:00100000:2.0:1762166794.906024:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 680 00010000:00010000:0.0:1762166794.906030:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 10 pid: 28434 timeout: 514 lvb_type: 1 00000100:00100000:2.0:1762166794.906042:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440126080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166794.906056:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166794.906060:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0c881 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7eea expref: 10 pid: 28434 timeout: 514 lvb_type: 1 00010000:00010000:2.0:1762166794.906067:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 10 pid: 8380 timeout: 514 lvb_type: 1 00010000:00010000:0.0:1762166794.906075:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.906079:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.906082:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906089:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 9 pid: 8380 timeout: 514 lvb_type: 1 00010000:00010000:0.0:1762166794.906099:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906131:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166794.906135:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166794.906141:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166794.906147:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906158:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906181:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166794.906189:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440125824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 216us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166794.906198:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 679 00000100:00100000:2.0:1762166794.906220:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440126080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 180us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.906229:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 680 00010000:00010000:0.0:1762166794.906355:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945d00f15000/0x2f180c4effb0c87a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ee3 expref: 7 pid: 8380 timeout: 514 lvb_type: 1 00000100:00100000:0.0:1762166794.906367:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446834688:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166794.906378:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.906385:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.906396:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.906403:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.906408:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166794.906425:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166794.906456:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166794.906465:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906474:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166794.906733:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906743:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906757:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906764:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc37b7e00/0x2f180c4effb0c984 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.906781:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166794.906783:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166794.906792:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166794.907311:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3636:x1847765446833792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3738us (4001us total) trans 21474836703 rc 0/0 00000100:00100000:3.0:1762166794.907320:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1762166794.907345:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440125952 00000100:00100000:3.0:1762166794.907350:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440125952 00000004:00080000:2.0:1762166794.907351:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a0a680/2, rc 0, transno 21474836703 00000100:00100000:2.0:1762166794.907358:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446833792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166794.907380:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1057 00000100:00100000:3.0:1762166794.907388:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+7:47335:x1847765440125952:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1762166794.907400:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166794.907415:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f30 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166794.907444:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166794.907457:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166794.907459:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166794.907467:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 8 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.907505:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 8 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.907516:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fce00, rc 0) 00010000:00010000:2.0:1762166794.907535:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166794.907551:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+8:47335:x1847765440125952:12345-192.168.204.38@tcp:101:dd.0 Request processed in 163us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166794.907557:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1057 00010000:00010000:3.0:1762166794.907589:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.907596:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.907604:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.907610:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.907631:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166794.907652:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166794.907660:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.907669:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fcc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166794.907673:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.907681:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.907694:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.907702:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fcc00/0x2f180c4effb0c97d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.907722:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166794.907724:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166794.907730:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166794.908574:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3635:x1847765446833664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3956us (4143us total) trans 17179869380 rc 0/0 00000100:00100000:1.0:1762166794.908591:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3634:x1847765446833536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5134us (5350us total) trans 21474836702 rc 0/0 00000100:00100000:0.0:1762166794.908591:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000004:00080000:2.0:1762166794.908601:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55de300/2, rc 0, transno 17179869380 00000100:00100000:2.0:1762166794.908615:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446833664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166794.908616:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000004:00080000:1.0:1762166794.908663:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a08a80/2, rc 0, transno 21474836702 00000100:00100000:1.0:1762166794.908668:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446833536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166794.909460:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765446833920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5387us (5603us total) trans 17179869381 rc 0/0 00000004:00080000:1.0:1762166794.909461:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dce00/2, rc 0, transno 17179869381 00000100:00100000:1.0:1762166794.909466:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446833920:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166794.909469:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1762166794.909546:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166794.909573:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440126208 00000100:00100000:3.0:1762166794.909577:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440126208 00002000:00010000:3.0:1762166794.909594:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/71 (0->18446744073709551615) 00002000:00100000:3.0:1762166794.909598:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4944700 with x1847765440126208 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166794.909604:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4944700. 00000100:00100000:3.0:1762166794.909622:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 491 00000100:00100000:3.0:1762166794.909629:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440126208:12345-192.168.204.38@tcp:10:dd.0 00002000:00010000:3.0:1762166794.909712:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166794.909715:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb mtime from disk: 0 -> 1762166795 00002000:00010000:3.0:1762166794.909716:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166794.909718:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb ctime from disk: 0 -> 1762166795 00002000:00010000:3.0:1762166794.909719:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166794.909750:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440126208:12345-192.168.204.38@tcp:10:dd.0 Request processed in 123us (207us total) trans 17179869382 rc 0/0 00000100:00100000:3.0:1762166794.909754:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 491 00002000:00010000:3.0:1762166794.909756:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/71 (0->18446744073709551615) 00002000:00100000:3.0:1762166794.909758:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4944700 with x1847765440126208 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166794.909761:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4944700. 00000100:00100000:0.0:1762166794.921009:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.921107:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440126464 00000100:00100000:1.0:1762166794.921121:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440126464 00000100:00100000:1.0:1762166794.921180:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 823 00000100:00100000:1.0:1762166794.921190:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:47335:x1847765440126464:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:1.0:1762166794.921514:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:47335:x1847765440126464:12345-192.168.204.38@tcp:35:dd.0 Request processed in 324us (517us total) trans 4294969005 rc 0/0 00000100:00100000:1.0:1762166794.921523:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 823 00000100:00100000:0.0:1762166794.929032:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.929098:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440126592 00000100:00100000:1.0:1762166794.929107:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440126592 00000100:00100000:1.0:1762166794.929162:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2835 00000100:00100000:1.0:1762166794.929172:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:47336:x1847765440126592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166794.929211:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166794.929229:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f37 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.929298:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.929312:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.929323:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166794.929366:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166794.929369:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166794.929385:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.929406:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0c992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f37 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.929425:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f37 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.929433:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166794.929436:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166794.929440:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14600, rc 0) 00000100:00100000:1.0:1762166794.929525:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:47336:x1847765440126592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 353us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.929532:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2835 00000100:00100000:0.0:1762166794.930826:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.930876:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440126720 00000100:00100000:1.0:1762166794.930887:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440126720 00000100:00100000:1.0:1762166794.930927:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2836 00000100:00100000:1.0:1762166794.930934:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:47336:x1847765440126720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166794.930946:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166794.930957:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c9a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f3e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.930996:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931007:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931014:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931027:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931033:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931039:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931100:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931107:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931113:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166794.931147:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00000004:00200000:1.0:1762166794.931150:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166794.931161:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931171:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931179:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931186:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931191:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931197:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931203:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166794.931207:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931220:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931229:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166794.931232:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166794.931235:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931241:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0c9a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931258:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931263:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931269:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931273:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166794.931276:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931293:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931301:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff945cd4634100) 00010000:00010000:1.0:1762166794.931303:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166794.931306:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931311:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0c9ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.931335:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0c9a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.931346:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 24 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.931353:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166794.931360:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166794.931363:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15200, rc 0) 00000100:00100000:1.0:1762166794.931400:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:47336:x1847765440126720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 467us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.931407:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2836 00000100:00100000:0.0:1762166794.932878:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.932914:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440126976 00000100:00100000:1.0:1762166794.932920:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440126976 00000100:00100000:1.0:1762166794.932952:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2837 00000100:00100000:1.0:1762166794.932960:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:47336:x1847765440126976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166794.932972:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166794.932981:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c9bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.933034:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.933045:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.933053:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.933079:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.933092:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 25 pid: 6494 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1762166794.933105:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446834816:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166794.933183:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166794.934124:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446834816:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166794.934138:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166794.934421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.934462:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440127104 00000100:00100000:1.0:1762166794.934466:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440127104 00010000:00010000:1.0:1762166794.934499:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 26 pid: 6494 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1762166794.934525:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 681 00000100:00100000:1.0:1762166794.934531:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440127104:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166794.934539:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166794.934545:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 26 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.934553:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 26 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.934566:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0c9b5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f3e expref: 26 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.934575:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166794.934578:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.934583:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.934595:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.934615:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166794.934643:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440127104:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 111us (229us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166794.934648:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166794.934649:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 681 00010000:00010000:2.0:1762166794.934680:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166794.934700:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00010000:00010000:2.0:1762166794.934852:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0c9bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.934871:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.934881:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166794.934884:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166794.934887:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14000, rc 0) 00000100:00100000:2.0:1762166794.934951:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:47336:x1847765440126976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1990us (2075us total) trans 4294969006 rc 0/0 00000100:00100000:2.0:1762166794.934960:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2837 00000100:00100000:0.0:1762166794.936119:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.936162:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440127232 00000100:00100000:2.0:1762166794.936170:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440127232 00000100:00100000:2.0:1762166794.936215:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2838 00000100:00100000:2.0:1762166794.936228:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:47336:x1847765440127232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166794.936248:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166794.936263:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0c9d1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f4c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.936357:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.936369:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.936385:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.936418:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.936430:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 26 pid: 6494 timeout: 514 lvb_type: 0 00000100:00100000:2.0:1762166794.936443:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446834944:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166794.936537:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf785c000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166794.937361:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446834944:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166794.937379:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166794.937591:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.937645:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440127360 00000100:00100000:1.0:1762166794.937652:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440127360 00010000:00010000:1.0:1762166794.937675:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 27 pid: 6494 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1762166794.937708:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 682 00000100:00100000:1.0:1762166794.937717:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440127360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166794.937729:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166794.937740:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 27 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.937751:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 27 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.937766:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0c9c3 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f45 expref: 27 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.937777:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166794.937780:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.937785:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.937796:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.937814:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166794.937842:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440127360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (254us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166794.937844:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166794.937850:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 682 00010000:00010000:2.0:1762166794.937859:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166794.937896:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00000004:00200000:2.0:1762166794.937900:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166794.937917:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.937939:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0c9d1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f4c expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.937949:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f4c expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.937960:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166794.937962:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166794.937964:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae5600, rc 0) 00000100:00100000:2.0:1762166794.937997:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:47336:x1847765440127232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1773us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.938002:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2838 00000100:00100000:0.0:1762166794.939160:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.939212:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440127616 00000100:00100000:2.0:1762166794.939219:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440127616 00000100:00100000:2.0:1762166794.939260:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2839 00000100:00100000:2.0:1762166794.939272:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:47336:x1847765440127616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166794.939301:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166794.939317:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9df lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f53 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.939411:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0c9e6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.939424:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0c9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.939434:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0c9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166794.939446:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00010000:00010000:2.0:1762166794.939630:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9df lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f53 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.939646:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0c9e6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f53 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.939664:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166794.939667:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166794.939669:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4600, rc 0) 00000100:00100000:2.0:1762166794.939717:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:47336:x1847765440127616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 449us (572us total) trans 4294969007 rc 0/0 00000100:00100000:2.0:1762166794.939726:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2839 00000100:00100000:0.0:1762166794.940696:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166794.940748:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440127744 00000100:00100000:3.0:1762166794.940754:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440127744 00000100:00100000:3.0:1762166794.940789:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1058 00000100:00100000:3.0:1762166794.940798:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+9:2416:x1847765440127744:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166794.940833:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.940851:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 9 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.940857:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166794.940858:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166794.940861:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.940889:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 9 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.940900:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 9 pid: 28434 timeout: 514 lvb_type: 0 00000100:00100000:3.0:1762166794.940917:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446835072:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166794.940975:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166794.941876:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446835072:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166794.941902:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166794.942616:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166794.942694:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440127872 00000100:00100000:3.0:1762166794.942702:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440127872 00002000:00100000:3.0:1762166794.942738:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x47:0x0] (0->1048575) req@ffff945bc4945f80 x1847765440127872/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:580/0 lens 488/0 e 0 to 0 dl 1762166805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166794.942746:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4945f80 with x1847765440127872 ext(0->1048575) 00010000:00010000:3.0:1762166794.942762:0:23943:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 10 pid: 28434 timeout: 514 lvb_type: 0 00010000:00010000:3.0:1762166794.942773:0:23943:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 10 pid: 28434 timeout: 514 lvb_type: 0 00002000:00010000:3.0:1762166794.942778:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945bc4945f80 00000100:00100000:3.0:1762166794.942803:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:3.0:1762166794.942810:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440127872:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:3.0:1762166794.948328:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440127872:12345-192.168.204.38@tcp:4:dd.0 Request processed in 5509us (5707us total) trans 17179869383 rc 0/0 00000100:00100000:3.0:1762166794.948340:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00002000:00100000:3.0:1762166794.948354:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x47:0x0] (0->1048575) req@ffff945bc4945f80 x1847765440127872/t17179869383(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:580/0 lens 488/448 e 0 to 0 dl 1762166805 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166794.948365:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4945f80 with x1847765440127872 ext(0->1048575) 00010000:00010000:3.0:1762166794.948375:0:23943:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 12 pid: 28434 timeout: 514 lvb_type: 0 00010000:00010000:3.0:1762166794.948393:0:23943:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 12 pid: 28434 timeout: 514 lvb_type: 0 00002000:00010000:3.0:1762166794.948399:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945bc4945f80 00000100:00100000:0.0:1762166794.950054:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.950091:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440128000 00000100:00100000:1.0:1762166794.950100:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440128000 00010000:00010000:1.0:1762166794.950129:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 12 pid: 28434 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1762166794.950162:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 683 00000100:00100000:1.0:1762166794.950175:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440128000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166794.950187:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1762166794.950200:0:6481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1762166794.950203:0:6481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1762166794.950207:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 12 pid: 28434 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.950219:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 12 pid: 28434 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.950243:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fce00/0x2f180c4effb0c98b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f30 expref: 12 pid: 28434 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166794.950264:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166794.950276:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166794.950291:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.950301:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166794.950328:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166794.950365:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440128000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 195us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.950373:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 683 00010000:00010000:3.0:1762166794.950427:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.950435:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.950456:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.950462:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.950467:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.950471:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fc000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166794.950474:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.950502:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.950548:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.950553:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0c9f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166794.950684:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2416:x1847765440127744:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 9877us (9979us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.950701:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1058 00000100:00100000:0.0:1762166794.951616:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.951673:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440128256 00000100:00100000:2.0:1762166794.951682:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440128256 00000100:00100000:2.0:1762166794.951736:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2840 00000100:00100000:2.0:1762166794.951744:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:47336:x1847765440128256:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166794.951802:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166794.951828:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0c968 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f29 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.951850:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0c9d8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f4c expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.951863:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166794.951868:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166794.951901:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.951916:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.951938:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000040:00080000:2.0:1762166794.952170:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].123, 88 off18152 00000004:00080000:2.0:1762166794.952180:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414100701628ns, next at 414412353984ns, rc = 0 00000040:00080000:2.0:1762166794.952226:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].130, 88 off18720 00000004:00080000:2.0:1762166794.952233:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414100754933ns, next at 414412249989ns, rc = 0 00000001:00080000:0.0:1762166794.953319:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969008 is committed 00000004:00080000:0.0:1762166794.953336:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 121 committed 00000004:00080000:0.0:1762166794.953350:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 112 committed 00000100:00100000:0.0:1762166794.953453:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446835200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166794.953461:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446835328:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1762166794.953465:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003e352c77 reply state 00000000d2320d07 transno 4294969008 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.953524:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.953533:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166794.953537:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166794.953541:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166794.953569:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166794.953615:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1762166794.953640:0:6494:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762166794.953662:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:47336:x1847765440128256:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1913us (2041us total) trans 4294969008 rc 0/0 00000100:00100000:2.0:1762166794.953678:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2840 00010000:00010000:1.0:1762166794.953680:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.953694:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.953702:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.953712:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166794.953718:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.953728:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166794.953741:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166794.953745:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166794.953748:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446835200 00010000:00010000:1.0:1762166794.953749:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:2.0:1762166794.953756:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446835200 00010000:00010000:1.0:1762166794.953758:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4400/0x2f180c4effb0c9fb lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166794.953767:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446835328 00000100:00100000:3.0:1762166794.953776:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446835328 00000100:00100000:2.0:1762166794.953808:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1762166794.953824:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3635:x1847765446835200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166794.953848:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1762166794.953861:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3636:x1847765446835328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166794.954021:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3636:x1847765446835328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (407us total) trans 17179869384 rc 0/0 00000100:00100000:2.0:1762166794.954026:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3635:x1847765446835200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (458us total) trans 21474836704 rc 0/0 00000100:00100000:0.0:1762166794.954035:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1762166794.954048:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000004:00080000:1.0:1762166794.954081:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5f5ce00/2, rc 0, transno 21474836704 00000004:00080000:3.0:1762166794.954088:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc0380/2, rc 0, transno 17179869384 00000100:00100000:1.0:1762166794.954091:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446835200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166794.954099:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446835328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166794.954881:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.954928:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440128384 00000100:00100000:2.0:1762166794.954936:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440128384 00000100:00100000:2.0:1762166794.954994:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2841 00000100:00100000:2.0:1762166794.955005:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:47336:x1847765440128384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166794.955026:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166794.955044:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f5a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.955093:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 23 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.955107:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 23 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.955124:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166794.955127:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166794.955130:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4c00, rc 0) 00000100:00100000:2.0:1762166794.955183:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:47336:x1847765440128384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 180us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.955190:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2841 00000100:00100000:0.0:1762166794.956437:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.956528:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440128512 00000100:00100000:2.0:1762166794.956541:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440128512 00000100:00100000:2.0:1762166794.956589:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2842 00000100:00100000:2.0:1762166794.956598:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:47336:x1847765440128512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166794.956615:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166794.956632:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5200/0x2f180c4effb0ca09 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f61 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.956731:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4e00/0x2f180c4effb0ca10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.956760:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4e00/0x2f180c4effb0ca10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.956772:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4e00/0x2f180c4effb0ca10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166794.956804:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00000004:00200000:2.0:1762166794.956810:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166794.956830:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4e00/0x2f180c4effb0ca10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166794.956857:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5200/0x2f180c4effb0ca09 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f61 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.956873:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4e00/0x2f180c4effb0ca10 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f61 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.956882:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166794.956884:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166794.956887:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4e00, rc 0) 00000100:00100000:2.0:1762166794.956937:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:47336:x1847765440128512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 340us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.956944:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2842 00000100:00100000:0.0:1762166794.958025:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166794.958070:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440128640 00000100:00100000:2.0:1762166794.958075:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440128640 00000100:00100000:2.0:1762166794.958107:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1061 00000100:00100000:2.0:1762166794.958114:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440128640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166794.958131:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166794.958162:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effb0ca17 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f68 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166794.958198:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x47:0x0] initial LVB size: 1048576, mtime: 0x6908880b, atime: 0x0, ctime: 0x6908880b, blocks: 0x800 00010000:00010000:2.0:1762166794.958219:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166794.958222:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166794.958230:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effb0ca17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f68 expref: 11 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166794.958246:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effb0ca17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f68 expref: 11 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166794.958258:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4800, rc 0) 00000100:00100000:2.0:1762166794.958311:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440128640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 197us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166794.958318:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1061 00000100:00100000:0.0:1762166794.980579:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166794.980652:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440128768 00000100:00100000:3.0:1762166794.980667:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440128768 00000100:00100000:3.0:1762166794.980736:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1062 00000100:00100000:3.0:1762166794.980748:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440128768:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166794.980879:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440128768:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 135us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166794.980885:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1062 00000100:00100000:3.0:1762166794.981985:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166794.982030:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440128896 00000100:00100000:1.0:1762166794.982036:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440128896 00000100:00100000:1.0:1762166794.982070:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1063 00000100:00100000:1.0:1762166794.982080:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440128896:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166794.982156:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440128896:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 78us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166794.982165:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1063 00000100:00100000:1.0:1762166794.983654:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166794.983691:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440129024 00000100:00100000:3.0:1762166794.983698:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440129024 00000100:00100000:3.0:1762166794.983743:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 492 00000100:00100000:3.0:1762166794.983749:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440129024:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166794.983777:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.983792:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166794.983794:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166794.983799:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.983811:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.987523:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.987557:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.987566:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.987573:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fc000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166794.987578:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.987585:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.987603:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.987607:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fc000/0x2f180c4effb0ca1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166794.987678:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440129024:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3926us (4027us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166794.987686:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 492 00000100:00100000:0.0:1762166794.990677:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166794.990725:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440129152 00000100:00100000:3.0:1762166794.990743:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440129152 00000100:00100000:3.0:1762166794.990813:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 493 00000100:00100000:3.0:1762166794.990824:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440129152:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166794.990871:0:23943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166794.990892:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.990907:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166794.990909:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166794.990913:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166794.990926:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166794.996855:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836705 is committed 00000001:00080000:1.0:1762166794.996871:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836704 is committed 00002000:00010000:2.0:1762166794.997019:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1762166794.997026:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb mtime from disk: 0 -> 1762166795 00002000:00010000:2.0:1762166794.997029:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb ctime from disk: 0 -> 1762166795 00002000:00010000:2.0:1762166794.997030:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1762166794.997044:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.997052:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.997058:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.997076:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fce00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166794.997079:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.997086:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.997102:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166794.997107:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0ca25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166794.997216:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440129152:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 6388us (6542us total) trans 21474836705 rc 0/0 00000100:00100000:2.0:1762166794.997229:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 493 00000100:00100000:1.0:1762166795.009117:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166795.009189:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440129408 00000100:00100000:2.0:1762166795.009199:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440129408 00000100:00100000:2.0:1762166795.009256:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2843 00000100:00100000:2.0:1762166795.009268:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:47336:x1847765440129408:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166795.009334:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166795.009360:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4e00/0x2f180c4effb0ca10 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f61 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.009380:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166795.009385:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166795.009603:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 3/0,1 mode: --/PW res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.009617:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.009626:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:2.0:1762166795.009671:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969009 00000004:00010000:2.0:1762166795.009695:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000347066d6 reply state 000000005393b132 transno 4294969010 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.009706:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.009712:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166795.009715:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166795.009718:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166795.009802:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:47336:x1847765440129408:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 536us (692us total) trans 4294969010 rc 0/0 00000100:00100000:2.0:1762166795.009810:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2843 00000020:00080000:2.0:1762166795.009816:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166795.010956:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166795.011111:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440129536 00000100:00100000:1.0:1762166795.011119:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440129536 00000100:00100000:1.0:1762166795.011164:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1064 00000100:00100000:1.0:1762166795.011174:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+8:47336:x1847765440129536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166795.011187:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166795.011205:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ca33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f6f expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166795.011225:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4d:0x0] initial LVB size: 1048576, mtime: 0x6908880b, atime: 0x0, ctime: 0x6908880b, blocks: 0x800 00010000:00010000:1.0:1762166795.011242:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166795.011244:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166795.011251:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ca33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f6f expref: 9 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166795.011293:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ca33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f6f expref: 9 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166795.011305:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15e00, rc 0) 00000100:00100000:1.0:1762166795.011355:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+9:47336:x1847765440129536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166795.011362:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1064 00000100:00100000:0.0:1762166795.012271:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166795.012333:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440129664 00000100:00100000:2.0:1762166795.012343:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440129664 00002000:00010000:2.0:1762166795.012382:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/77 (1048576->18446744073709551615) 00002000:00100000:2.0:1762166795.012387:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc58cea00 with x1847765440129664 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1762166795.012398:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc58cea00. 00000100:00100000:2.0:1762166795.012437:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 494 00000100:00100000:2.0:1762166795.012448:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440129664:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166795.012648:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1762166795.012664:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb mtime from disk: 1762166795 -> 1762166795 00002000:00010000:2.0:1762166795.012667:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166795.012669:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb ctime from disk: 1762166795 -> 1762166795 00002000:00010000:2.0:1762166795.012672:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1762166795.012730:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440129664:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 283us (459us total) trans 21474836706 rc 0/0 00000100:00100000:2.0:1762166795.012739:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 494 00002000:00010000:2.0:1762166795.012745:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/77 (1048576->18446744073709551615) 00002000:00100000:2.0:1762166795.012748:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc58cea00 with x1847765440129664 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1762166795.012754:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc58cea00. 00000100:00100000:0.0:1762166795.013709:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166795.013755:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440129920 00000100:00100000:2.0:1762166795.013762:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440129920 00000100:00100000:2.0:1762166795.013811:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2844 00000100:00100000:2.0:1762166795.013822:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:47336:x1847765440129920:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166795.013948:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 3/0,1 mode: --/PW res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.013968:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.013980:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:2.0:1762166795.014084:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008c484c32 reply state 00000000e359c405 transno 4294969011 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.014099:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.014107:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166795.014119:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166795.014123:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166795.014207:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:47336:x1847765440129920:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 387us (502us total) trans 4294969011 rc 0/0 00000100:00100000:2.0:1762166795.014215:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2844 00000100:00100000:0.0:1762166795.015196:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166795.015253:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440130048 00000100:00100000:1.0:1762166795.015265:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440130048 00000100:00100000:1.0:1762166795.015330:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1065 00000100:00100000:1.0:1762166795.015340:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440130048:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166795.015500:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1762166795.015504:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb mtime from disk: 1762166795 -> 1762166795 00002000:00010000:1.0:1762166795.015506:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb atime from disk: 0 -> 1762166795 00002000:00010000:1.0:1762166795.015507:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb ctime from disk: 1762166795 -> 1762166795 00002000:00010000:1.0:1762166795.015509:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1762166795.015564:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440130048:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 225us (372us total) trans 17179869385 rc 0/0 00000100:00100000:1.0:1762166795.015572:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1065 00000100:00100000:0.0:1762166795.016561:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166795.016630:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440130304 00000100:00100000:1.0:1762166795.016637:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440130304 00000100:00100000:1.0:1762166795.016674:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 824 00000100:00100000:1.0:1762166795.016683:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:47336:x1847765440130304:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166795.016742:0:6498:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0xc:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0c9e6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f53 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166795.016799:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166795.016813:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166795.016820:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166795.016852:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166795.016867:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 28 pid: 6494 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1762166795.016881:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446835456:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166795.016983:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166795.017939:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446835456:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166795.017959:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:0.0:1762166795.018255:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166795.018383:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440130432 00000100:00100000:1.0:1762166795.018390:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440130432 00010000:00010000:1.0:1762166795.018416:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 29 pid: 6494 timeout: 514 lvb_type: 0 00000100:00100000:1.0:1762166795.018452:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 684 00000100:00100000:1.0:1762166795.018465:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440130432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166795.018530:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166795.018538:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 29 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166795.018551:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 29 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166795.018570:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4c00/0x2f180c4effb0ca02 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f5a expref: 29 pid: 6494 timeout: 514 lvb_type: 0 00010000:00010000:1.0:1762166795.018586:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166795.018590:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166795.018597:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166795.018603:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166795.018626:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166795.018663:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166795.018670:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440130432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 201us (414us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166795.018683:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166795.018691:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 684 00000040:00080000:3.0:1762166795.019010:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].124, 88 off18240 00000004:00080000:3.0:1762166795.019023:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414167543951ns, next at 414412353984ns, rc = 0 00000040:00080000:3.0:1762166795.019073:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].131, 88 off18808 00000004:00080000:3.0:1762166795.019081:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414167602931ns, next at 414412249989ns, rc = 0 00000001:00080000:0.0:1762166795.020269:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969012 is committed 00000004:00080000:0.0:1762166795.020278:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 122 committed 00000004:00080000:0.0:1762166795.020304:0:6475:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 113 committed 00010000:00010000:1.0:1762166795.020314:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020331:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020340:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020356:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae5600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166795.020360:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020367:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020380:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:1.0:1762166795.020383:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166795.020388:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020393:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0ca2c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020407:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020412:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020416:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020419:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae5e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166795.020420:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020424:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166795.020431:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00000100:00100000:0.0:1762166795.020431:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446835712:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166795.020433:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166795.020444:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000004:00010000:2.0:1762166795.020448:0:6498:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004ad96831 reply state 00000000ff8fafe1 transno 4294969012 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166795.020452:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0ca3a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.020500:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166795.020511:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166795.020514:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166795.020518:0:6498:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166795.020525:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166795.020526:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166795.020531:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166795.020537:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0c9e6 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xc:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f53 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166795.020567:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446835584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166795.020578:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446835712 00000100:00100000:1.0:1762166795.020587:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446835712 00000100:00100000:0.0:1762166795.020604:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166795.020632:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446835584 00000100:00100000:1.0:1762166795.020636:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446835584 00010000:00080000:2.0:1762166795.020652:0:6498:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762166795.020671:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:47336:x1847765440130304:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3986us (4110us total) trans 4294969012 rc 0/0 00000100:00100000:1.0:1762166795.020672:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1762166795.020684:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1762166795.020684:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765446835712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166795.020686:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 824 00010000:00010000:0.0:1762166795.020690:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166795.020700:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166795.020707:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166795.020711:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446835584:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762166795.020718:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166795.020723:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166795.020729:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166795.020740:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:0.0:1762166795.020743:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166795.020746:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166795.020752:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0ca41 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00002000:00010000:1.0:1762166795.020825:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1762166795.020826:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1762166795.020833:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb mtime from disk: 1762166795 -> 1762166795 00002000:00010000:1.0:1762166795.020834:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb mtime from disk: 1762166795 -> 1762166795 00002000:00010000:3.0:1762166795.020837:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166795.020839:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb atime from disk: 1762166795 -> 1762166795 00002000:00010000:3.0:1762166795.020842:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb ctime from disk: 1762166795 -> 1762166795 00002000:00010000:3.0:1762166795.020847:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1762166795.020849:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb ctime from disk: 1762166795 -> 1762166795 00002000:00010000:1.0:1762166795.020854:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1762166795.020944:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446835584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (338us total) trans 21474836707 rc 0/0 00000100:00100000:1.0:1762166795.020956:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3633:x1847765446835712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 271us (428us total) trans 17179869386 rc 0/0 00000100:00100000:3.0:1762166795.020964:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1762166795.020971:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000004:00080000:0.0:1762166795.020974:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55de680/2, rc 0, transno 17179869386 00000100:00100000:0.0:1762166795.020984:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446835712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166795.020999:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836704 gen 2 00000004:00080000:0.0:1762166795.021005:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5588380, transno 21474836677 00000004:00080000:0.0:1762166795.021019:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5589f80, transno 21474836679 00000004:00080000:0.0:1762166795.021022:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc558bb80, transno 21474836680 00000004:00080000:0.0:1762166795.021026:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6c000, transno 21474836683 00000004:00080000:0.0:1762166795.021035:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6d880, transno 21474836684 00000004:00080000:0.0:1762166795.021039:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2d5ca80, transno 21474836687 00000004:00080000:0.0:1762166795.021043:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2d5ea00, transno 21474836688 00000004:00080000:0.0:1762166795.021046:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28700, transno 21474836689 00000004:00080000:0.0:1762166795.021049:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a29880, transno 21474836690 00000004:00080000:0.0:1762166795.021052:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd1c00, transno 21474836695 00000004:00080000:0.0:1762166795.021055:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd0000, transno 21474836696 00000004:00080000:0.0:1762166795.021058:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58cf480, transno 21474836699 00000004:00080000:0.0:1762166795.021061:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58cca80, transno 21474836700 00000004:00080000:0.0:1762166795.021063:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a0b480, transno 21474836701 00000004:00080000:0.0:1762166795.021066:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a08a80, transno 21474836702 00000004:00080000:0.0:1762166795.021068:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a0a680, transno 21474836703 00000004:00080000:0.0:1762166795.021070:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5f5ce00, transno 21474836704 00000100:00100000:0.0:1762166795.021078:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc2d5ed80 x1847765446835584/t21474836707(21474836707) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166811 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166795.021088:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc2d5ed80/2, rc 0, transno 21474836707 00000100:00100000:0.0:1762166795.021092:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446835584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762166795.021176:0:9163:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 12 in progress, 0 in flight, 6 done 00000004:00080000:2.0:1762166795.021253:0:9163:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 11 done 00000100:00100000:0.0:1762166795.021750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166795.021792:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440130560 00000100:00100000:2.0:1762166795.021797:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440130560 00000100:00100000:2.0:1762166795.021834:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2845 00000100:00100000:2.0:1762166795.021840:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:47336:x1847765440130560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166795.021857:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166795.021884:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5800/0x2f180c4effb0ca48 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f76 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.021936:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5800/0x2f180c4effb0ca48 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f76 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.021951:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5800/0x2f180c4effb0ca48 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f76 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.021975:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166795.021977:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166795.021980:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae5800, rc 0) 00000100:00100000:2.0:1762166795.022016:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:47336:x1847765440130560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 175us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166795.022022:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2845 00000100:00100000:2.0:1762166795.023238:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166795.023300:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440130816 00000100:00100000:3.0:1762166795.023307:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440130816 00000100:00100000:3.0:1762166795.023348:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 825 00000100:00100000:3.0:1762166795.023354:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:47336:x1847765440130816:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166795.023580:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:47336:x1847765440130816:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 226us (348us total) trans 4294969013 rc 0/0 00000100:00100000:3.0:1762166795.023587:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 825 00010000:00010000:2.0:1762166795.026650:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166795.029085:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166795.029158:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440131072 00000100:00100000:2.0:1762166795.029167:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440131072 00000100:00100000:2.0:1762166795.029220:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2846 00000100:00100000:2.0:1762166795.029231:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:47337:x1847765440131072:12345-192.168.204.38@tcp:101:filefrag.0 00010000:00010000:2.0:1762166795.029259:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166795.029289:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0ca4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f7d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.029362:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029375:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029399:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029413:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029419:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029425:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029632:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5c00/0x2f180c4effb0ca64 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029642:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5c00/0x2f180c4effb0ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029649:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5c00/0x2f180c4effb0ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166795.029658:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00010000:00010000:2.0:1762166795.029735:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029742:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029748:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029753:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029758:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae5a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166795.029769:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029777:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029788:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:2.0:1762166795.029791:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166795.029795:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029801:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0ca56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029815:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029820:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029825:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029830:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166795.029833:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029838:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029845:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdb08acc (ffff945cf39a3300) 00010000:00010000:2.0:1762166795.029847:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166795.029850:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029866:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcdb08acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.029920:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0ca4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f7d expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.029930:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5c00/0x2f180c4effb0ca64 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f7d expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.029938:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166795.029940:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166795.029943:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae5c00, rc 0) 00000100:00100000:2.0:1762166795.030023:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:47337:x1847765440131072:12345-192.168.204.38@tcp:101:filefrag.0 Request processed in 793us (944us total) trans 4294969014 rc 0/0 00000100:00100000:2.0:1762166795.030033:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2846 00000100:00100000:0.0:1762166795.031613:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166795.031660:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440131200 00000100:00100000:2.0:1762166795.031668:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440131200 00000100:00100000:2.0:1762166795.031726:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2847 00000100:00100000:2.0:1762166795.031741:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:47337:x1847765440131200:12345-192.168.204.38@tcp:41:filefrag.0 00000004:00000024:2.0:1762166795.031788:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7842770944 avail 7373336576 00000100:00100000:2.0:1762166795.031842:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:47337:x1847765440131200:12345-192.168.204.38@tcp:41:filefrag.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166795.031850:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2847 00000100:00100000:0.0:1762166795.033245:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166795.033314:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440131328 00000100:00100000:1.0:1762166795.033320:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440131328 00000100:00100000:1.0:1762166795.033356:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1068 00000100:00100000:1.0:1762166795.033364:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:47337:x1847765440131328:12345-192.168.204.38@tcp:7:filefrag.0 00000100:00100000:1.0:1762166795.033455:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:47337:x1847765440131328:12345-192.168.204.38@tcp:7:filefrag.0 Request processed in 93us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166795.033461:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1068 00000100:00100000:0.0:1762166795.034372:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166795.034419:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440131456 00000100:00100000:1.0:1762166795.034424:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440131456 00000100:00100000:1.0:1762166795.034457:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1069 00000100:00100000:1.0:1762166795.034461:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:47337:x1847765440131456:12345-192.168.204.38@tcp:7:filefrag.0 00000100:00100000:1.0:1762166795.034548:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:47337:x1847765440131456:12345-192.168.204.38@tcp:7:filefrag.0 Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166795.034554:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1069 00000100:00100000:0.0:1762166795.035554:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166795.035595:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440131712 00000100:00100000:3.0:1762166795.035603:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440131712 00000100:00100000:3.0:1762166795.035656:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 826 00000100:00100000:3.0:1762166795.035668:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:47337:x1847765440131712:12345-192.168.204.38@tcp:35:filefrag.0 00000100:00100000:3.0:1762166795.035967:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:47337:x1847765440131712:12345-192.168.204.38@tcp:35:filefrag.0 Request processed in 301us (418us total) trans 4294969015 rc 0/0 00000100:00100000:3.0:1762166795.035976:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 826 00000100:00100000:0.0:1762166795.043323:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166795.043387:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440131968 00000100:00100000:2.0:1762166795.043398:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440131968 00000100:00100000:2.0:1762166795.043508:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2848 00000100:00100000:2.0:1762166795.043525:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:47339:x1847765440131968:12345-192.168.204.38@tcp:101:filefrag.0 00010000:00010000:2.0:1762166795.043609:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166795.043634:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0ca72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f84 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.043772:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca79 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.043789:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca79 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166795.043801:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca79 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166795.043813:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00010000:00010000:2.0:1762166795.043941:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4600/0x2f180c4effb0ca72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f84 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.043959:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca79 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f84 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166795.043970:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945bc4180400) 00010000:00010000:2.0:1762166795.043973:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166795.043977:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4a00, rc 0) 00000100:00100000:2.0:1762166795.044064:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:47339:x1847765440131968:12345-192.168.204.38@tcp:101:filefrag.0 Request processed in 544us (755us total) trans 4294969016 rc 0/0 00000100:00100000:2.0:1762166795.044073:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2848 00000100:00100000:0.0:1762166795.045756:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166795.045837:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440132096 00000100:00100000:1.0:1762166795.045848:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440132096 00000100:00100000:1.0:1762166795.045900:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1070 00000100:00100000:1.0:1762166795.045909:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:47339:x1847765440132096:12345-192.168.204.38@tcp:7:filefrag.0 00000100:00100000:1.0:1762166795.046027:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:47339:x1847765440132096:12345-192.168.204.38@tcp:7:filefrag.0 Request processed in 119us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166795.046033:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1070 00000100:00100000:0.0:1762166795.046740:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166795.046775:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440132224 00000100:00100000:1.0:1762166795.046780:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440132224 00000100:00100000:1.0:1762166795.046802:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1071 00000100:00100000:1.0:1762166795.046807:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:47339:x1847765440132224:12345-192.168.204.38@tcp:7:filefrag.0 00000100:00100000:1.0:1762166795.046869:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:47339:x1847765440132224:12345-192.168.204.38@tcp:7:filefrag.0 Request processed in 62us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166795.046873:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1071 00000100:00100000:3.0:1762166795.538646:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1762166795.538653:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446835840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166795.538665:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446835968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1762166795.538748:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166795.538777:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446835840 00000100:00100000:3.0:1762166795.538786:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446835840 00000100:00100000:2.0:1762166795.538832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166795.538875:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446835968 00000100:00100000:1.0:1762166795.538880:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446835968 00000100:00100000:3.0:1762166795.538901:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1762166795.538913:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1762166795.538915:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3634:x1847765446835840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166795.538926:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446835968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1762166795.538942:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44515008 pending 1073152 free 3923488768 avail 3691966464 00002000:00000024:3.0:1762166795.538943:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44515008 pending 1073152 free 3923488768 avail 3691966464 00000100:00100000:2.0:1762166795.539003:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446835968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166795.539009:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3634:x1847765446835840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166795.539016:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1762166795.539023:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1762166795.539054:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446835968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1762166795.539067:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446835840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1762166796.050721:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166796.051703:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446836096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166796.051823:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166796.051983:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446836096 00000100:00100000:1.0:1762166796.051999:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446836096 00000100:00100000:1.0:1762166796.052088:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1762166796.052106:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446836096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1762166796.052156:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445933056 avail 1299693568 00000100:00100000:1.0:1762166796.052223:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446836096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166796.052232:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1762166796.052344:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446836096:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1762166796.052353:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967469 is committed 00000100:00100000:3.0:1762166796.562816:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446836224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166796.562907:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166796.562963:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446836224 00000100:00100000:1.0:1762166796.562976:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446836224 00000100:00100000:1.0:1762166796.563031:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1762166796.563040:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446836224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1762166796.563068:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446199296 avail 1299959808 00000100:00100000:1.0:1762166796.563131:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446836224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166796.563137:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1762166796.563176:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967469 gen 2 00000004:00080000:3.0:1762166796.563184:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967462 committed transno 4294967469 00000004:00080000:3.0:1762166796.563213:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967463 committed transno 4294967469 00000004:00080000:3.0:1762166796.563226:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967464 committed transno 4294967469 00000004:00080000:3.0:1762166796.563238:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967465 committed transno 4294967469 00000004:00080000:3.0:1762166796.563247:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967466 committed transno 4294967469 00000004:00080000:3.0:1762166796.563282:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967467 committed transno 4294967469 00000004:00080000:3.0:1762166796.563292:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967468 committed transno 4294967469 00000004:00080000:3.0:1762166796.563302:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967469 committed transno 4294967469 00000100:00100000:3.0:1762166796.563323:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446836224:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1762166797.074686:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762166797.242862:0:31694:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50A: mirror split update layout generation ========================================================== 05:46:36 (1762166796) 00000100:00100000:0.0:1762166797.261316:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.261390:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440132480 00000100:00100000:1.0:1762166797.261408:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440132480 00000100:00080000:0.0:1762166797.261462:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166797.261553:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2849 00000100:00100000:1.0:1762166797.261568:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:47922:x1847765440132480:12345-192.168.204.38@tcp:36:mkdir.0 00010000:00010000:1.0:1762166797.261645:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166797.261681:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0c999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f37 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.261700:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166797.261706:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166797.261779:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.261808:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.261820:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.261838:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.261843:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.261848:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262450:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262461:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262469:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166797.262542:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac602ea8 reply state 0000000018885752 transno 4294969017 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262556:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262563:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:1.0:1762166797.262566:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166797.262569:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1762166797.262575:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00010000:00010000:1.0:1762166797.262593:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262602:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262608:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262614:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262620:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.262626:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262635:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262645:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166797.262647:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166797.262652:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262659:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166797.262669:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac602ea8 reply state 0000000018885752 transno 4294969017 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262675:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.262679:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff945cd4634a00) 00010000:00010000:1.0:1762166797.262681:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166797.262689:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1762166797.262798:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:47922:x1847765440132480:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 1228us (1491us total) trans 4294969017 rc 0/0 00000100:00100000:1.0:1762166797.262806:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2849 00000100:00100000:0.0:1762166797.271961:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.272018:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440132608 00000100:00100000:1.0:1762166797.272030:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440132608 00000100:00100000:1.0:1762166797.272091:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2850 00000100:00100000:1.0:1762166797.272105:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:47925:x1847765440132608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166797.272129:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166797.272150:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f8b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.272226:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0caa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.272254:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0caa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.272266:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0caa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166797.272305:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166797.272311:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166797.272328:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0caa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.272349:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0ca9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f8b expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.272364:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0caa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f8b expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.272384:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166797.272387:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166797.272391:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14600, rc 0) 00000100:00100000:1.0:1762166797.272452:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:47925:x1847765440132608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 351us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166797.272460:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2850 00000100:00100000:0.0:1762166797.274348:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.274424:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440132736 00000100:00100000:1.0:1762166797.274431:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440132736 00000100:00100000:1.0:1762166797.274500:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2851 00000100:00100000:1.0:1762166797.274510:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:47925:x1847765440132736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166797.274526:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166797.274541:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0caaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f92 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.274589:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274600:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274609:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274619:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274626:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274632:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274705:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0cabf lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274713:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0cabf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274720:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0cabf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166797.274748:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00000004:00200000:1.0:1762166797.274752:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166797.274765:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0cabf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274776:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274783:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274789:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274794:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274800:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.274804:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274810:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274820:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:1.0:1762166797.274828:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166797.274832:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274838:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0cab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274848:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274853:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274859:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274864:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.274866:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274872:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274880:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff945cd4634a00) 00010000:00010000:1.0:1762166797.274882:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166797.274885:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274890:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0cab8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.274911:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0caaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f92 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.274934:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0cabf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f92 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.274941:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:1.0:1762166797.274943:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1762166797.274945:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14800, rc 0) 00000100:00100000:1.0:1762166797.274991:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:47925:x1847765440132736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 482us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166797.274998:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2851 00000100:00100000:3.0:1762166797.276398:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.276445:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440132992 00000100:00100000:1.0:1762166797.276452:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440132992 00000100:00100000:1.0:1762166797.276568:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2852 00000100:00100000:1.0:1762166797.276578:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:47925:x1847765440132992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166797.276591:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166797.276603:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0cac6 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f99 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.276671:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.276683:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.276692:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.276706:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.276726:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.276734:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277067:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277075:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277083:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166797.277091:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:1.0:1762166797.277117:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277123:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277129:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277136:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277142:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.277145:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 4/0,0 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277152:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 5/0,0 mode: CW/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277172:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:1.0:1762166797.277175:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166797.277179:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 3/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277185:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0cacd lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166797.277197:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000330d8fde reply state 00000000231893a8 transno 4294969018 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277206:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.277212:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945cd4634c00) 00010000:00010000:1.0:1762166797.277215:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166797.277217:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166797.277257:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0cac6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.277273:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.277281:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd4634300) 00010000:00010000:1.0:1762166797.277283:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166797.277286:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14200, rc 0) 00000100:00100000:1.0:1762166797.277353:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:47925:x1847765440132992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 777us (957us total) trans 4294969018 rc 0/0 00000100:00100000:1.0:1762166797.277361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2852 00000100:00100000:2.0:1762166797.278781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.278834:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440133248 00000100:00100000:1.0:1762166797.278849:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440133248 00000100:00100000:1.0:1762166797.278902:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2853 00000100:00100000:1.0:1762166797.278915:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:47925:x1847765440133248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166797.278932:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166797.278945:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0cae9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fa0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.279009:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.279022:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.279030:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.279059:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.279073:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 35 pid: 6494 timeout: 516 lvb_type: 0 00000100:00100000:1.0:1762166797.279086:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446836352:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166797.279179:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166797.280019:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446836352:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166797.280041:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166797.280281:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.280333:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440133376 00000100:00100000:1.0:1762166797.280339:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440133376 00010000:00010000:1.0:1762166797.280375:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 36 pid: 6494 timeout: 516 lvb_type: 0 00000100:00100000:1.0:1762166797.280411:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 685 00000100:00100000:1.0:1762166797.280419:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440133376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166797.280428:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166797.280432:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 36 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.280440:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 36 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.280454:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0cadb lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f99 expref: 36 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.280464:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd4634300) 00010000:00010000:1.0:1762166797.280467:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.280472:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.280545:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.280567:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166797.280587:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166797.280596:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765440133376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 178us (316us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166797.280599:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166797.280607:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 685 00000004:00200000:0.0:1762166797.280613:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000004:00080000:0.0:1762166797.280756:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4e:0x0], index 0: 0 00010000:00010000:0.0:1762166797.280852:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.280860:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.280867:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.280872:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166797.280876:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.280883:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.280892:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd4634300) 00010000:00010000:0.0:1762166797.280895:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166797.280899:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.280904:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3c00/0x2f180c4effb0caf0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.280947:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0cae9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa0 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166797.280964:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:0.0:1762166797.280967:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166797.280971:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0cae9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa0 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166797.280980:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15a00, rc 0) 00000100:00100000:0.0:1762166797.281018:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:47925:x1847765440133248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2108us (2246us total) trans 4294969019 rc 301/301 00000100:00100000:0.0:1762166797.281026:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2853 00000100:00100000:3.0:1762166797.282129:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166797.282175:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440133632 00000100:00100000:0.0:1762166797.282181:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440133632 00000100:00100000:0.0:1762166797.282226:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 827 00000100:00100000:0.0:1762166797.282235:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:47925:x1847765440133632:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166797.282413:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:47925:x1847765440133632:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 175us (282us total) trans 4294969020 rc 0/0 00000100:00100000:0.0:1762166797.282421:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 827 00000100:00100000:3.0:1762166797.283645:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166797.283695:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440133760 00000100:00100000:0.0:1762166797.283702:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440133760 00000100:00100000:0.0:1762166797.283748:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2854 00000100:00100000:0.0:1762166797.283757:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+35:47925:x1847765440133760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166797.283776:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166797.283796:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fa7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166797.283836:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166797.283859:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166797.283878:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:0.0:1762166797.283882:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166797.283885:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1200, rc 0) 00000100:00100000:0.0:1762166797.283923:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:47925:x1847765440133760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 168us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166797.283930:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2854 00000100:00100000:2.0:1762166797.285893:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166797.285960:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440134016 00000100:00100000:0.0:1762166797.285969:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440134016 00000100:00100000:0.0:1762166797.286017:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 828 00000100:00100000:0.0:1762166797.286029:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:47925:x1847765440134016:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166797.286219:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:47925:x1847765440134016:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 192us (343us total) trans 4294969021 rc 0/0 00000100:00100000:0.0:1762166797.286229:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 828 00000100:00100000:0.0:1762166797.294196:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.294262:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440134272 00000100:00100000:1.0:1762166797.294278:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440134272 00000100:00100000:1.0:1762166797.294341:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2855 00000100:00100000:1.0:1762166797.294354:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:47931:x1847765440134272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166797.294378:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166797.294399:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0cb05 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fae expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.294474:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294516:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294527:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294539:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294546:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294553:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294652:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0cb1a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294660:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294665:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166797.294682:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:1.0:1762166797.294757:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294763:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294768:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294773:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294778:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e2200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.294782:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294788:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294798:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:1.0:1762166797.294802:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166797.294806:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294812:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2200/0x2f180c4effb0cb0c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294822:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294826:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294843:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294848:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc9e3600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.294851:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294857:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294865:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945cd4634c00) 00010000:00010000:1.0:1762166797.294880:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166797.294883:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294889:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3600/0x2f180c4effb0cb13 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.294925:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2a00/0x2f180c4effb0cb05 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fae expref: 40 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.294938:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0cb1a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fae expref: 39 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.294945:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:1.0:1762166797.294947:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166797.294950:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3a00, rc 0) 00000100:00100000:1.0:1762166797.295004:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:47931:x1847765440134272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 652us (812us total) trans 4294969022 rc 0/0 00000100:00100000:1.0:1762166797.295011:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2855 00000100:00100000:1.0:1762166797.297745:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166797.297831:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440134528 00000100:00100000:0.0:1762166797.297840:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440134528 00000100:00100000:0.0:1762166797.297902:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2856 00000100:00100000:0.0:1762166797.297913:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:47931:x1847765440134528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166797.297936:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166797.297956:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cb28 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fb5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166797.298416:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.298437:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166797.298447:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:0.0:1762166797.298456:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x10:0x0]: returning size 0 00010000:00010000:0.0:1762166797.298510:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cb28 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166797.298523:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166797.298529:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc4180d00) 00010000:00010000:0.0:1762166797.298531:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166797.298534:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0200, rc 0) 00000100:00100000:0.0:1762166797.298586:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:47931:x1847765440134528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 676us (848us total) trans 4294969023 rc 0/0 00000100:00100000:0.0:1762166797.298591:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2856 00000100:00100000:2.0:1762166797.300221:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166797.300276:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440134784 00000100:00100000:2.0:1762166797.300283:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440134784 00000100:00100000:2.0:1762166797.300328:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2857 00000100:00100000:2.0:1762166797.300337:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:47931:x1847765440134784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166797.300369:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166797.300385:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0cb3d lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fbc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.300461:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166797.300473:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.300508:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166797.300552:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.300565:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 42 pid: 6494 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1762166797.300580:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446836480:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166797.300677:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3db3900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166797.301990:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446836480:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166797.302015:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166797.302193:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166797.302224:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440134912 00000100:00100000:2.0:1762166797.302231:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440134912 00010000:00010000:2.0:1762166797.302270:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 43 pid: 6494 timeout: 516 lvb_type: 0 00000100:00100000:2.0:1762166797.302302:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 686 00000100:00100000:2.0:1762166797.302309:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:2419:x1847765440134912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166797.302321:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166797.302327:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 43 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:2.0:1762166797.302340:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 43 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:2.0:1762166797.302360:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c0200/0x2f180c4effb0cb2f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fb5 expref: 43 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:2.0:1762166797.302373:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc4180d00) 00010000:00010000:2.0:1762166797.302378:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166797.302393:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166797.302400:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166797.302423:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166797.302441:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166797.302449:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166797.302457:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765440134912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (266us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166797.302463:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x10:0x0]: returning size 0 00000100:00100000:2.0:1762166797.302464:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 686 00000004:00080000:1.0:1762166797.302606:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x48:0x0], index 1: 0 00010000:00010000:1.0:1762166797.302694:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166797.302703:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166797.302709:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166797.302715:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae5e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.302719:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166797.302726:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166797.302750:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc4180d00) 00010000:00010000:1.0:1762166797.302754:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166797.302758:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166797.302772:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5e00/0x2f180c4effb0cb44 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166797.302824:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0cb3d lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fbc expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.302834:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:1.0:1762166797.302837:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166797.302842:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5600/0x2f180c4effb0cb3d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fbc expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166797.302854:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae5600, rc 0) 00000100:00100000:1.0:1762166797.302883:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:47931:x1847765440134784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2549us (2668us total) trans 4294969024 rc 301/301 00000100:00100000:1.0:1762166797.302891:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2857 00000100:00100000:2.0:1762166797.304042:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.304256:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440135168 00000100:00100000:3.0:1762166797.304262:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440135168 00000100:00100000:3.0:1762166797.304300:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 829 00000100:00100000:3.0:1762166797.304309:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:47931:x1847765440135168:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166797.304539:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+42:47931:x1847765440135168:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 232us (500us total) trans 4294969025 rc 0/0 00000100:00100000:3.0:1762166797.304545:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 829 00000100:00100000:1.0:1762166797.305959:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.306117:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440135296 00000100:00100000:3.0:1762166797.306129:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440135296 00000100:00080000:1.0:1762166797.306170:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166797.306186:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1072 00000100:00100000:3.0:1762166797.306196:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440135296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166797.306209:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166797.306227:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fc3 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166797.306262:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166797.306279:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166797.306281:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166797.306290:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 11 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166797.306305:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 11 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166797.306317:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fc000, rc 0) 00000100:00100000:3.0:1762166797.306385:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440135296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 190us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166797.306391:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1072 00000100:00100000:1.0:1762166797.307749:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166797.307821:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440135424 00000100:00100000:2.0:1762166797.307828:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440135424 00000100:00100000:2.0:1762166797.307877:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2858 00000100:00100000:2.0:1762166797.307885:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+42:47931:x1847765440135424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166797.307902:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166797.307918:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb59 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.307978:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0cb60 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166797.307989:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0cb60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166797.307999:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0cb60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166797.308035:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x10:0x0]: returning size 0 00000004:00200000:2.0:1762166797.308039:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166797.308062:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0cb60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166797.308086:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb59 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fca expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.308100:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0cb60 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fca expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.308107:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945cf39a3300) 00010000:00010000:2.0:1762166797.308111:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166797.308113:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4000, rc 0) 00000100:00100000:2.0:1762166797.308157:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:47931:x1847765440135424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 272us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166797.308163:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2858 00000100:00100000:2.0:1762166797.309669:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.309707:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440135552 00000100:00100000:3.0:1762166797.309714:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440135552 00000100:00100000:3.0:1762166797.309766:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1073 00000100:00100000:3.0:1762166797.309776:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440135552:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:1.0:1762166797.309778:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1762166797.309791:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166797.309810:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fd1 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166797.309845:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166797.309861:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166797.309864:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166797.309870:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 13 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166797.309889:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 13 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166797.309906:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fca00, rc 0) 00000100:00100000:3.0:1762166797.309946:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440135552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 173us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166797.309953:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1073 00000100:00100000:1.0:1762166797.311543:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.311718:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440135808 00000100:00100000:3.0:1762166797.311724:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440135808 00000100:00100000:3.0:1762166797.311791:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2859 00000100:00100000:3.0:1762166797.311803:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+43:47931:x1847765440135808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166797.311817:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166797.311832:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb6e lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fd8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.311938:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cb75 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.311951:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cb75 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.311962:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cb75 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166797.311980:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:3.0:1762166797.312080:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb6e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd8 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.312099:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cb75 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd8 expref: 45 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.312107:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:3.0:1762166797.312110:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166797.312114:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fd400, rc 0) 00000100:00100000:3.0:1762166797.312161:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+45:47931:x1847765440135808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 361us (621us total) trans 4294969026 rc 0/0 00000100:00100000:3.0:1762166797.312172:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2859 00000100:00100000:1.0:1762166797.314064:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166797.314280:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440135936 00000100:00100000:2.0:1762166797.314295:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440135936 00000100:00100000:2.0:1762166797.314373:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1074 00000100:00100000:2.0:1762166797.314385:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440135936:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166797.314440:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314456:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166797.314459:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166797.314464:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314561:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314609:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314619:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314627:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314634:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae5a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166797.314638:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314644:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314657:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166797.314662:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae5a00/0x2f180c4effb0cb83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166797.314760:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440135936:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 376us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166797.314769:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1074 00000100:00100000:1.0:1762166797.339344:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.339434:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440136064 00000100:00100000:3.0:1762166797.339445:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440136064 00000100:00100000:3.0:1762166797.339526:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2860 00000100:00100000:3.0:1762166797.339537:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+45:47931:x1847765440136064:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:0.0:1762166797.340664:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969026 is committed 00010000:00010000:1.0:1762166797.340692:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340701:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340712:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340724:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.340727:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340733:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340746:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff945cd4634a00) 00010000:00010000:1.0:1762166797.340749:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166797.340751:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340755:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ca8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340772:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340776:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340780:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340783:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.340785:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340788:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340792:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:1.0:1762166797.340797:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166797.340799:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340803:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ca95 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340813:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340816:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340819:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340822:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166797.340824:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340827:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340833:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945cd4634c00) 00010000:00010000:1.0:1762166797.340836:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166797.340837:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:47931:x1847765440136064:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1299us (1500us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166797.340838:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166797.340850:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cad4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166797.340856:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2860 00000100:00100000:3.0:1762166797.341965:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166797.342000:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440136192 00000100:00100000:2.0:1762166797.342014:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440136192 00000100:00100000:2.0:1762166797.342055:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1075 00000100:00100000:2.0:1762166797.342065:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440136192:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166797.342132:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440136192:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166797.342138:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1075 00000100:00100000:2.0:1762166797.349714:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.350288:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440136320 00000100:00100000:3.0:1762166797.350304:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440136320 00000100:00100000:3.0:1762166797.351021:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1076 00000100:00100000:3.0:1762166797.351038:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440136320:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166797.351115:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351142:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166797.351144:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166797.351149:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351163:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351190:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351196:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351202:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351207:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fc200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166797.351210:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351215:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351226:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.351251:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cb8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166797.351413:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440136320:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 379us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166797.351422:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1076 00000100:00100000:1.0:1762166797.353323:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.353391:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440136576 00000100:00100000:3.0:1762166797.353416:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440136576 00000100:00100000:3.0:1762166797.353569:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2861 00000100:00100000:3.0:1762166797.353598:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:47931:x1847765440136576:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166797.353707:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166797.353748:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4000/0x2f180c4effb0cb60 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fca expref: 29 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.353773:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945cf39a3300) 00010000:00010000:3.0:1762166797.353791:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166797.353840:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.353855:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.353864:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:3.0:1762166797.354046:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000006c58570 reply state 00000000e8d41e51 transno 4294969027 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.354077:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.354082:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc580a300) 00010000:00010000:3.0:1762166797.354085:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166797.354087:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166797.354217:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:47931:x1847765440136576:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 627us (908us total) trans 4294969027 rc 0/0 00000100:00100000:3.0:1762166797.354225:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2861 00000100:00100000:1.0:1762166797.355808:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.355912:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440136704 00000100:00100000:3.0:1762166797.355923:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440136704 00000100:00100000:3.0:1762166797.356015:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2862 00000100:00100000:3.0:1762166797.356032:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:47931:x1847765440136704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166797.356079:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166797.356112:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fdf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.356193:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.356211:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.356230:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc580a300) 00010000:00010000:3.0:1762166797.356232:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166797.356247:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fcc00, rc 0) 00000100:00100000:3.0:1762166797.356316:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:47931:x1847765440136704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 287us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166797.356352:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2862 00000100:00100000:2.0:1762166797.357798:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.357878:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440136832 00000100:00100000:3.0:1762166797.357892:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440136832 00000100:00100000:3.0:1762166797.357953:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1077 00000100:00100000:3.0:1762166797.357965:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440136832:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166797.358280:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166797.358285:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb mtime from disk: 0 -> 1762166797 00002000:00010000:3.0:1762166797.358288:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb atime from disk: 0 -> 1762166797 00002000:00010000:3.0:1762166797.358291:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb ctime from disk: 0 -> 1762166797 00002000:00010000:3.0:1762166797.358295:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166797.358389:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440136832:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 420us (594us total) trans 17179869387 rc 0/0 00000100:00100000:3.0:1762166797.358404:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1077 00000100:00100000:1.0:1762166797.359834:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.359893:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440137088 00000100:00100000:3.0:1762166797.359909:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440137088 00000100:00100000:3.0:1762166797.359963:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2863 00000100:00100000:3.0:1762166797.359975:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:47931:x1847765440137088:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166797.360028:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166797.360064:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3a00/0x2f180c4effb0cb1a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fae expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.360084:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:3.0:1762166797.360089:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166797.360136:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.360149:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.360164:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:3.0:1762166797.360296:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002550c866 reply state 000000005043f21d transno 4294969028 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.360308:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.360314:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:3.0:1762166797.360317:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166797.360319:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166797.360413:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:47931:x1847765440137088:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 440us (584us total) trans 4294969028 rc 0/0 00000100:00100000:3.0:1762166797.360422:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2863 00000100:00100000:1.0:1762166797.361636:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.361670:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440137216 00000100:00100000:3.0:1762166797.361676:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440137216 00000100:00100000:3.0:1762166797.361712:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1078 00000100:00100000:3.0:1762166797.361721:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440137216:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166797.361848:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166797.361851:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb mtime from disk: 0 -> 1762166797 00002000:00010000:3.0:1762166797.361853:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb atime from disk: 0 -> 1762166797 00002000:00010000:3.0:1762166797.361854:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb ctime from disk: 0 -> 1762166797 00002000:00010000:3.0:1762166797.361856:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166797.361892:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440137216:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 172us (257us total) trans 21474836708 rc 0/0 00000100:00100000:3.0:1762166797.361899:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1078 00000100:00100000:2.0:1762166797.363015:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.363053:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440137472 00000100:00100000:3.0:1762166797.363069:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440137472 00000100:00100000:3.0:1762166797.363105:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 830 00000100:00100000:3.0:1762166797.363113:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:47931:x1847765440137472:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166797.363169:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0xf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cb75 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd8 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.363248:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166797.363260:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.363269:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166797.363307:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.363322:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 32 pid: 6494 timeout: 516 lvb_type: 0 00000100:00100000:3.0:1762166797.363340:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446836608:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166797.363432:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eee180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166797.364467:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446836608:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166797.364504:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166797.364737:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.364799:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440137600 00000100:00100000:1.0:1762166797.364805:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440137600 00010000:00010000:1.0:1762166797.364830:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 33 pid: 6494 timeout: 516 lvb_type: 0 00000100:00100000:1.0:1762166797.364860:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 687 00000100:00100000:1.0:1762166797.364870:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765440137600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166797.364880:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166797.364885:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 33 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.364897:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 33 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.364912:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1200/0x2f180c4effb0cafe lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fa7 expref: 33 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.364926:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:1.0:1762166797.364930:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166797.364938:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166797.364945:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166797.364967:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166797.364986:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166797.365009:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166797.365011:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765440137600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 142us (274us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166797.365032:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166797.365041:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 687 00010000:00010000:3.0:1762166797.365048:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.365057:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 4/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166797.365079:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.365091:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 31 pid: 6494 timeout: 516 lvb_type: 0 00000100:00100000:3.0:1762166797.365102:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446836736:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166797.365143:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eee180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166797.365861:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446836736:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166797.365873:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166797.366064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166797.366110:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440137728 00000100:00100000:1.0:1762166797.366115:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440137728 00010000:00010000:1.0:1762166797.366132:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 32 pid: 6494 timeout: 516 lvb_type: 0 00000100:00100000:1.0:1762166797.366161:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 688 00000100:00100000:1.0:1762166797.366170:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440137728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166797.366179:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166797.366183:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 32 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.366194:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 32 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.366207:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cb98 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fdf expref: 32 pid: 6494 timeout: 516 lvb_type: 0 00010000:00010000:1.0:1762166797.366219:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc580a300) 00010000:00010000:1.0:1762166797.366222:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,1 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166797.366229:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166797.366235:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166797.366267:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166797.366280:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166797.366286:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166797.366305:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440137728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166797.366314:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 688 00000100:00100000:3.0:1762166797.366590:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446836864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166797.366618:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166797.366635:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166797.366663:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446836864 00000100:00100000:1.0:1762166797.366669:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446836864 00000100:00080000:0.0:1762166797.366719:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166797.366735:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1762166797.366745:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446836864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166797.366814:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446836864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166797.366820:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1762166797.366858:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446836864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166797.366911:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446836992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166797.366939:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166797.366959:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446836992 00000100:00100000:0.0:1762166797.366961:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eee180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166797.366963:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446836992 00000100:00100000:3.0:1762166797.366998:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00080000:1.0:1762166797.367001:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166797.367005:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6498:x1847765446836992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166797.367052:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6498:x1847765446836992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166797.367056:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1762166797.367096:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446836992:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:0.0:1762166797.367220:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].29, 280 off56672 00000001:00080000:0.0:1762166797.367253:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969029 00000100:00100000:0.0:1762166797.367295:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446837120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166797.367320:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166797.367345:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166797.367368:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446837120 00000100:00100000:3.0:1762166797.367373:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446837120 00000100:00100000:3.0:1762166797.367413:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1762166797.367420:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6498:x1847765446837120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166797.367532:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6498:x1847765446837120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (210us total) trans 17179869388 rc 0/0 00000100:00100000:3.0:1762166797.367539:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1762166797.367557:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446837120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166797.367574:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446837248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166797.367590:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166797.367605:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166797.367620:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446837248 00000100:00100000:3.0:1762166797.367624:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446837248 00000100:00100000:3.0:1762166797.367653:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1762166797.367665:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446837248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166797.367742:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6498:x1847765446837248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (150us total) trans 21474836709 rc 0/0 00000100:00100000:3.0:1762166797.367750:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1762166797.367766:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446837248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166797.367799:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294969030 00010000:00010000:0.0:1762166797.367816:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367823:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367827:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367831:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fce00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166797.367835:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367841:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367852:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc580a300) 00010000:00010000:0.0:1762166797.367855:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166797.367859:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 2/0,0 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367881:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbad lrc: 0/0,0 mode: --/EX res: [0x200000405:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367893:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367899:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367904:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367908:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fde00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166797.367910:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367914:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367928:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:0.0:1762166797.367933:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166797.367936:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367941:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cba6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.367953:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:0.0:1762166797.367956:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166797.367961:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cb75 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd8 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166797.368026:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:47931:x1847765440137472:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4914us (5012us total) trans 4294969031 rc 0/0 00000100:00100000:0.0:1762166797.368039:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 830 00000020:00080000:0.0:1762166797.368044:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166797.369145:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.369188:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440137856 00000100:00100000:3.0:1762166797.369193:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440137856 00000100:00100000:3.0:1762166797.369228:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2864 00000100:00100000:3.0:1762166797.369247:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:47931:x1847765440137856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166797.369262:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166797.369276:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cbb4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.369309:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fe6 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.369318:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fe6 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.369328:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:3.0:1762166797.369329:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166797.369331:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fc200, rc 0) 00000100:00100000:3.0:1762166797.369368:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:47931:x1847765440137856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 132us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166797.369375:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2864 00000100:00100000:2.0:1762166797.370570:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166797.370597:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440138112 00000100:00100000:0.0:1762166797.370601:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440138112 00000100:00100000:0.0:1762166797.370628:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 831 00000100:00100000:0.0:1762166797.370632:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:47931:x1847765440138112:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166797.370739:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:47931:x1847765440138112:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 106us (170us total) trans 4294969032 rc 0/0 00000100:00100000:0.0:1762166797.370744:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 831 00000100:00100000:2.0:1762166797.371688:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166797.371718:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440138368 00000100:00100000:0.0:1762166797.371721:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440138368 00000100:00100000:0.0:1762166797.371746:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 832 00000100:00100000:0.0:1762166797.371755:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:47931:x1847765440138368:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166797.371843:0:6498:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166797.371892:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.371901:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.371907:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.371913:0:6498:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.371929:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.371952:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166797.371969:0:6498:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166797.371998:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166797.372006:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166797.372015:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166797.372019:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166797.372027:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166797.372040:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc580a300) 00010000:00010000:2.0:1762166797.372043:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166797.372047:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 1/0,0 mode: --/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166797.372064:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cbbb lrc: 0/0,0 mode: --/PW res: [0x200000405:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 00000100:00100000:0.0:1762166797.372073:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:47931:x1847765440138368:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 319us (385us total) trans 4294969033 rc 0/0 00010000:00010000:2.0:1762166797.372078:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166797.372079:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 832 00010000:00010000:2.0:1762166797.372082:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166797.372086:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166797.383369:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.383420:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440138624 00000100:00100000:3.0:1762166797.383432:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440138624 00000100:00100000:3.0:1762166797.383533:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2865 00000100:00100000:3.0:1762166797.383543:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+35:47934:x1847765440138624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166797.383580:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166797.383600:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cbc2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7fed expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.383669:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383684:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383696:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383719:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383730:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383736:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383814:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383822:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383827:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383834:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383840:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fcc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166797.383849:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383865:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383879:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:3.0:1762166797.383883:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166797.383887:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383893:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0cbc9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383907:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383913:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383918:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383923:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fde00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166797.383925:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383931:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383937:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945bc580a600) 00010000:00010000:3.0:1762166797.383940:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166797.383943:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383958:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0cbd0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.383989:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cbc2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fed expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.383998:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:3.0:1762166797.384001:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166797.384004:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cbc2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fed expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.384012:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fd400, rc 0) 00000100:00100000:3.0:1762166797.384068:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+35:47934:x1847765440138624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 526us (710us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166797.384075:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2865 00000100:00100000:1.0:1762166797.385697:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.385806:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440138880 00000100:00100000:3.0:1762166797.385820:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440138880 00000100:00100000:3.0:1762166797.385885:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2866 00000100:00100000:3.0:1762166797.385897:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+35:47934:x1847765440138880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166797.385921:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166797.385944:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ff4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166797.386063:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00010000:00010000:3.0:1762166797.386182:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ff4 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.386194:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166797.386207:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166797.386211:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cbd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ff4 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166797.386225:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc13fce00, rc 0) 00000100:00100000:3.0:1762166797.386299:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:47934:x1847765440138880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 406us (605us total) trans 4294969034 rc 301/301 00000100:00100000:3.0:1762166797.386305:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2866 00000100:00100000:2.0:1762166797.387582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166797.387635:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440139008 00000100:00100000:3.0:1762166797.387642:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440139008 00000100:00100000:3.0:1762166797.387688:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2867 00000100:00100000:3.0:1762166797.387695:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:47934:x1847765440139008:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166797.387766:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387780:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387788:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387800:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387807:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387812:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387896:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387918:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387923:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166797.387959:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000004:00200000:3.0:1762166797.387963:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166797.387971:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387982:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387987:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387992:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387996:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.387999:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166797.388003:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388007:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388015:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945cd4634900) 00010000:00010000:3.0:1762166797.388017:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166797.388020:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388034:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7400/0x2f180c4effb0cbe5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388049:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388055:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388061:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388066:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166797.388069:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388075:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388083:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945bc580ae00) 00010000:00010000:3.0:1762166797.388086:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166797.388089:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388094:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6c00/0x2f180c4effb0cbec lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388110:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388117:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388123:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388135:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166797.388138:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388144:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388152:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:3.0:1762166797.388155:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166797.388158:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166797.388164:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b7c00/0x2f180c4effb0cbf3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166797.388234:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:47934:x1847765440139008:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 538us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166797.388256:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2867 00000100:00100000:2.0:1762166797.389914:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166797.390002:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440139264 00000100:00100000:0.0:1762166797.390011:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440139264 00000100:00100000:0.0:1762166797.390083:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 833 00000100:00100000:0.0:1762166797.390095:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:47934:x1847765440139264:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166797.390363:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:47934:x1847765440139264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 269us (455us total) trans 4294969035 rc 0/0 00000100:00100000:0.0:1762166797.390372:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 833 00000001:00080000:3.0:1762166797.588569:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869388 is committed 00000001:00080000:3.0:1762166797.588578:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869387 is committed 00000020:01000004:0.0:1762166798.036889:0:31791:0:(tgt_mount.c:1906:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1762166798.036981:0:31791:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.036997:0:31791:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.037012:0:31791:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.037019:0:31791:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.037047:0:31791:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1762166798.037060:0:31791:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1762166798.037077:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166798.037089:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.037100:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac600 already unused, calling callback (ffffffffc12c3c20) 00000100:00080000:0.0:1762166798.037103:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:2.0:1762166798.037105:0:7420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166798.037111:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1762166798.037117:0:7420:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1762166798.037119:0:31791:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1762166798.037134:0:7420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166798.037141:0:7420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1762166798.037143:0:7420:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1762166798.037147:0:7420:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1762166798.037163:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945cf1c58000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1762166798.037184:0:7420:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.037192:0:7420:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166798.037239:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.037256:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cf3cac600/0x2f180c4effafd0cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd0d3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166798.037261:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1847765446837376:0@lo:39:umount.0 00000100:00100000:0.0:1762166798.037261:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3634:1847765446837504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166798.037285:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166798.037289:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166798.037291:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166798.037376:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166798.037382:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166798.037426:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446837376 00000100:00100000:2.0:1762166798.037435:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446837376 00000100:00100000:1.0:1762166798.037506:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446837504 00000100:00100000:1.0:1762166798.037511:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446837504 00000100:00100000:2.0:1762166798.037543:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1762166798.037547:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1762166798.037557:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1847765446837376:12345-0@lo:39:umount.0 00000100:00100000:1.0:1762166798.037559:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3634:x1847765446837504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166798.037579:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1762166798.037587:0:6494:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcc3b 00010000:00010000:1.0:1762166798.037595:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cf786b800/0x2f180c4effafd0d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafd0cc expref: 23 pid: 6487 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1762166798.037598:0:6494:0:(import.c:65:import_set_state_nolock()) ffff945cf1c5c000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1762166798.037613:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166798.037661:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:3634:x1847765446837504:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166798.037669:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1762166798.037675:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3632:x1847765446837376:12345-0@lo:39:umount.0 Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166798.037685:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000020:00000080:2.0:1762166798.037694:0:6494:0:(genops.c:904:class_export_put()) final put ffff945cf1c5d800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1762166798.037723:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1762166798.037730:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf1c58000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1762166798.037744:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf1c5d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1762166798.037745:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1847765446837376:0@lo:39:umount.0 00000100:00080000:3.0:1762166798.037773:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1762166798.037778:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1762166798.037782:0:31791:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1762166798.037796:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3634:1847765446837504:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1762166798.037812:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cf1c5c000 for lustre-MDT0000 00010000:00010000:3.0:1762166798.038557:0:31791:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038566:0:31791:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038574:0:31791:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038582:0:31791:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038591:0:31791:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166798.038595:0:31791:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038599:0:31791:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038603:0:31791:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.038604:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166798.038616:0:31791:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.038618:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038644:0:31791:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166798.038652:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cac00 already unused, calling callback (ffffffffc12c3c20) 00010000:00010000:3.0:1762166798.038655:0:31791:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1762166798.038660:0:10256:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038662:0:31791:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.038665:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166798.038677:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038699:0:31791:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.038702:0:10256:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.038703:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa2ae00 already unused, calling callback (ffffffffc12c3c20) 00010000:00010000:3.0:1762166798.038705:0:31791:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166798.038712:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1762166798.038741:0:10256:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.038747:0:6483:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166798.038748:0:10256:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1762166798.038750:0:31791:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1762166798.038751:0:10256:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1762166798.038764:0:31791:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1762166798.038767:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038772:0:31791:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.038774:0:10256:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.038776:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1762166798.038780:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166798.038791:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166798.038794:0:6483:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1762166798.038800:0:6483:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1762166798.038809:0:31791:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.038816:0:10256:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166798.038826:0:6483:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.038832:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a600 already unused, calling callback (ffffffffc12c3c20) 00010000:00010000:2.0:1762166798.038845:0:6483:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1762166798.038846:0:31791:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166798.038846:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.038855:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.038864:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.038880:0:6482:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.038902:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cc29cac00/0x2f180c4effafd0da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd0e1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166798.038904:0:31791:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166798.038915:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945bcaa2ae00/0x2f180c4effb073fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effb07403 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1762166798.038921:0:31791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:00010000:0.0:1762166798.038922:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1762166798.038935:0:31791:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:0.0:1762166798.038956:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1762166798.038961:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1762166798.038961:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1762166798.038964:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1762166798.038968:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.038970:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166798.038975:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166798.038978:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4a600 already unused, calling callback (ffffffffc12c3c20) 10000000:00010000:1.0:1762166798.038984:0:10256:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.038985:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1762166798.038986:0:31791:0:(tgt_mount.c:1956:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1762166798.038996:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:2.0:1762166798.038997:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166798.039004:0:6482:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000020:00000080:3.0:1762166798.039005:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1762166798.039005:0:10256:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 00000020:02000400:3.0:1762166798.039011:0:31791:0:(obd_config.c:863:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1762166798.039027:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446837632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166798.039038:0:6482:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1762166798.039040:0:10256:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166798.039048:0:10256:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1762166798.039051:0:10256:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1762166798.039054:0:10256:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1762166798.039066:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.039075:0:10256:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166798.039080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166798.039080:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cf786a600/0x2f180c4effafd182 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafd189 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.039089:0:10256:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166798.039105:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.039110:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166798.039112:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a600/0x2f180c4effafcb9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f180c4effafcba1 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.039115:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166798.039124:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166798.039136:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166798.039142:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166798.039143:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1762166798.039145:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166798.039154:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446837760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166798.039167:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446837632 00000100:00100000:1.0:1762166798.039175:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446837632 00000100:00100000:0.0:1762166798.039179:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3634:1847765446838016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166798.039216:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1762166798.039236:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:3635:x1847765446837632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166798.039249:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166798.039261:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166798.039269:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cf786bc00/0x2f180c4effafd0e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafd0da expref: 22 pid: 6488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166798.039282:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446837888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166798.039283:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166798.039311:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446838016 00000100:00100000:0.0:1762166798.039317:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446838016 00000100:00100000:1.0:1762166798.039329:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:3635:x1847765446837632:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166798.039351:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1762166798.039358:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1762166798.039363:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166798.039371:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5309af7-bf8a-40d1-8f22-842c4953c1ea+21:3634:x1847765446838016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166798.039382:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166798.039387:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446837888 00000100:00100000:1.0:1762166798.039391:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446837888 00010000:00010000:0.0:1762166798.039395:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc0030c00/0x2f180c4effafcba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafcb9a expref: 22 pid: 6488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.039411:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166798.039417:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1762166798.039424:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+21:3633:x1847765446837888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166798.039430:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166798.039438:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc13fd000/0x2f180c4effafd189 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafd182 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.039447:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166798.039466:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5309af7-bf8a-40d1-8f22-842c4953c1ea+20:3634:x1847765446838016:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166798.039474:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1762166798.040060:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+19:3633:x1847765446837888:12345-0@lo:103:ldlm_bl.0 Request processed in 635us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166798.040069:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446837888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166798.040069:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1762166798.040088:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3634:1847765446838016:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1762166798.040128:0:31791:0:(mdt_handler.c:8098:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:2.0:1762166798.040137:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166798.040185:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446837760 00000100:00100000:0.0:1762166798.040192:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446837760 00000100:00100000:2.0:1762166798.040209:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446837632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1762166798.040257:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1762166798.040270:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5309af7-bf8a-40d1-8f22-842c4953c1ea+19:3635:x1847765446837760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166798.040280:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166798.040290:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bcc9e2400/0x2f180c4effb07403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb073fc expref: 19 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166798.040315:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166798.040357:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5309af7-bf8a-40d1-8f22-842c4953c1ea+18:3635:x1847765446837760:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166798.040365:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1762166798.040391:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446837760:0@lo:103:ldlm_bl.0 00000001:00080000:1.0:1762166798.041213:0:6475:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969035 is committed 00000020:00080000:1.0:1762166798.041243:0:6475:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc4033840 refcount 2 committed 0 result 0 batchid 52 00000020:00080000:1.0:1762166798.041247:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccc6b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc6399c00 00000020:00080000:1.0:1762166798.041250:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccc6b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4033000 00010000:00010000:0.0:1762166798.041252:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00000020:00080000:1.0:1762166798.041253:0:6475:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccc6ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3b92200 00000020:00080000:1.0:1762166798.041257:0:6475:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].29 00010000:00010000:0.0:1762166798.041267:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166798.041273:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166798.041279:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fdc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166798.041285:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166798.041292:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000020:00080000:2.0:1762166798.041299:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 52 committed batchid 51 00010000:00010000:0.0:1762166798.041313:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x10:0x0].0x0 (ffff945bc580a300) 00010000:00010000:0.0:1762166798.041319:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166798.041323:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000020:00000080:3.0:1762166798.041329:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00010000:00010000:0.0:1762166798.041330:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0cb91 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000020:00080000:3.0:1762166798.041341:0:31791:0:(genops.c:1836:print_export_data()) lustre-MDT0000: ACTIVE ffff945bc81f2800 e1e11365-ba0b-405b-99c9-a704373217f2 192.168.204.38@tcp 27 (0 0 21) 0 0 0 1: ffff945bc541a000 4294969035 stale:0 00000020:00080000:3.0:1762166798.041353:0:31791:0:(genops.c:1836:print_export_data()) lustre-MDT0000: ACTIVE ffff945cf4176800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1762166798.041360:0:31791:0:(genops.c:1836:print_export_data()) lustre-MDT0000: ACTIVE ffff945bccb4d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1762166798.041365:0:31791:0:(genops.c:1836:print_export_data()) lustre-MDT0000: ACTIVE ffff945cee056800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1762166798.041369:0:31791:0:(genops.c:1836:print_export_data()) lustre-MDT0000: ACTIVE ffff945cee051800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 1) 0 0 0 0: 0000000000000000 4294968889 stale:0 00000020:00080000:2.0:1762166798.041371:0:6526:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 51 00000020:00080000:3.0:1762166798.041374:0:31791:0:(genops.c:1570:class_disconnect_exports()) OBD device 5 (ffff945cc63731b0) has exports, disconnecting them 00010000:00010000:0.0:1762166798.041377:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00000020:00080000:3.0:1762166798.041382:0:31791:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.38@tcp (ffff945bc81f2800), last request at 1762166797 00000020:00000080:3.0:1762166798.041393:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0b525 00010000:00010000:0.0:1762166798.041397:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00000020:00010000:3.0:1762166798.041406:0:31791:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945bc81f2800: total 0 00000100:00080000:3.0:1762166798.041414:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945bc81f5800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1762166798.041424:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166798.041431:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fd800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166798.041434:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166798.041443:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000020:00010000:2.0:1762166798.041446:0:10257:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945bc81f2800: total 0 00010000:00010000:2.0:1762166798.041454:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166798.041457:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4180600) 00010000:00010000:0.0:1762166798.041463:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166798.041467:0:31791:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 192.168.204.38@tcp (ffff945bc81f2800): rc 0 00010000:00010000:0.0:1762166798.041468:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166798.041475:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0cb9f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000020:00080000:3.0:1762166798.041536:0:31791:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff945cf4176800), last request at 1762166794 00000020:00000080:3.0:1762166798.041541:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb073cb 00000100:00080000:3.0:1762166798.041554:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945cf4170000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1762166798.041579:0:31791:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff945cf4176800): rc 0 00010000:00010000:2.0:1762166798.041581:0:10257:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945bc81f2800, canceled 0 locks, left on hash table 21. 00000020:00000080:3.0:1762166798.041582:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf4176800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1762166798.041599:0:31791:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff945bccb4d000), last request at 1762166794 00010000:00010000:1.0:1762166798.041600:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1762166798.041602:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb072f2 00000100:00080000:3.0:1762166798.041610:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945bccb4c800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1762166798.041622:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15800/0x2f180c4effb0c317 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d23 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1762166798.041623:0:31791:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff945bccb4d000): rc 0 00000020:00000080:3.0:1762166798.041626:0:31791:0:(genops.c:904:class_export_put()) final put ffff945bccb4d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1762166798.041636:0:31791:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff945cee056800), last request at 1762166488 00010000:00010000:0.0:1762166798.041636:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1762166798.041644:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcd22 00010000:00010000:2.0:1762166798.041652:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0c1a4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c9e expref: 21 pid: 30829 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1762166798.041653:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945cee055800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1762166798.041678:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166798.041684:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14600/0x2f180c4effb0caa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f8b expref: 20 pid: 6494 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1762166798.041691:0:31791:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff945cee056800): rc 0 00000020:00000080:3.0:1762166798.041694:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cee056800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1762166798.041698:0:31791:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff945cee051800), last request at 1762166488 00000020:00000080:3.0:1762166798.041701:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcce3 00000020:00010000:3.0:1762166798.041703:0:31791:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945cee051800: total 3 00000100:00080000:3.0:1762166798.041705:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945cee057000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1762166798.041708:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bccb89600/0x2f180c4effb0bfba lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c2e expref: 19 pid: 6495 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1762166798.041716:0:31791:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff945cee051800): rc 0 00000004:00000080:3.0:1762166798.041721:0:31791:0:(mdd_device.c:2257:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8278730fb28 00010000:00010000:2.0:1762166798.041727:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0c94c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f1b expref: 18 pid: 6494 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1762166798.041734:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1762166798.041739:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967469 gen 3 00000020:00010000:1.0:1762166798.041739:0:10256:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945cee051800: total 3 00010000:00010000:2.0:1762166798.041749:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e3000/0x2f180c4effb0b564 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7964 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.041768:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5c00/0x2f180c4effb0ca64 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f7d expref: 16 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.041783:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae5800/0x2f180c4effb0ca48 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f76 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.041796:0:10256:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945cee051800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1762166798.041809:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cace00/0x2f180c4effb0b9e7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7aad expref: 14 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.041845:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15c00/0x2f180c4effb0c325 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d2a expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.041845:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effafd39d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafd396 expref: 2 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166798.041909:0:10256:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945cee051800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1762166798.041910:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0c1f1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cba expref: 12 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.041935:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cb5000/0x2f180c4effb0be86 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7bcc expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.041959:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0b9bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a9f expref: 10 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.041986:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cbb4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fe6 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.042006:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7800/0x2f180c4effb0bf51 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c0b expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.042021:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0c04d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c4a expref: 7 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.042041:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0ca79 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f84 expref: 6 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.042057:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c7200/0x2f180c4effb0bb84 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7afa expref: 5 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.042083:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0c0d9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c66 expref: 4 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.042103:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14800/0x2f180c4effb0cabf lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f92 expref: 3 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.042124:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcc9e2e00/0x2f180c4effb0b667 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b799c expref: 2 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166798.042154:0:10257:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945bc81f2800, canceled 21 locks, left on hash table 0. 00000020:00000080:0.0:1762166798.043648:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf4176800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1762166798.043700:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945bccb4d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1762166798.043733:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cee056800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1762166798.043769:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cf4170000 for lustre-MDT0000 00000020:00000080:0.0:1762166798.043774:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bccb4c800 for lustre-MDT0000 00000020:00000080:0.0:1762166798.043778:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cee055800 for lustre-MDT0000 00000100:00080000:3.0:1762166798.061869:0:31791:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1762166798.061903:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945cff205000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1762166798.061964:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446838144:0@lo:39:umount.0 00000100:00100000:0.0:1762166798.062029:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1762166798.062051:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1762166798.062066:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836704 gen 3 00000100:00100000:3.0:1762166798.062073:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945bc2d5ed80 x1847765446835584/t21474836707(21474836707) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166811 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.062080:0:31791:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2d5ed80, transno 21474836707 00000100:00100000:3.0:1762166798.062090:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945cf3db4e00 x1847765446837248/t21474836709(21474836709) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1762166813 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_001.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.062096:0:31791:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836709 committed transno 21474836704 00000100:00100000:0.0:1762166798.062102:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446838144 00000100:00100000:0.0:1762166798.062110:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446838144 00000004:00080000:3.0:1762166798.062116:0:31791:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:0.0:1762166798.062160:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1762166798.062168:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1847765446838144:12345-0@lo:39:umount.0 00000020:00000080:0.0:1762166798.062196:0:6500:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcd92 00000100:00080000:0.0:1762166798.062204:0:6500:0:(import.c:65:import_set_state_nolock()) ffff945cee00a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1762166798.062237:0:6500:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967469 00000100:00100000:0.0:1762166798.062378:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3632:x1847765446838144:12345-0@lo:39:umount.0 Request processed in 209us (349us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1762166798.062386:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00010000:00010000:0.0:1762166798.062410:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1762166798.062437:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cff205000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1762166798.062443:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446838144:0@lo:39:umount.0 00000100:00100000:0.0:1762166798.062524:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1847765446838272:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1762166798.064121:0:31791:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1762166798.064134:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945cf784a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1762166798.064159:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1762166798.064162:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869373 gen 3 00000100:00100000:3.0:1762166798.064170:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945bc4532300 x1847765446831104/t17179869377(17179869377) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166808 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.064177:0:31791:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4532300, transno 17179869377 00000100:00100000:3.0:1762166798.064190:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945bc4533800 x1847765446830848/t17179869378(17179869378) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166808 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.064196:0:31791:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4533800, transno 17179869378 00000100:00100000:3.0:1762166798.064201:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945bc55dc000 x1847765446834176/t17179869379(17179869379) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166810 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.064207:0:31791:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dc000, transno 17179869379 00000100:00100000:3.0:1762166798.064211:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945bc55de300 x1847765446833664/t17179869380(17179869380) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166810 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.064217:0:31791:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55de300, transno 17179869380 00000100:00100000:3.0:1762166798.064221:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945bc55dce00 x1847765446833920/t17179869381(17179869381) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166810 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.064249:0:31791:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dce00, transno 17179869381 00000100:00100000:3.0:1762166798.064255:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945bc5bc0380 x1847765446835328/t17179869384(17179869384) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166810 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.064261:0:31791:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc0380, transno 17179869384 00000100:00100000:3.0:1762166798.064266:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945bc55de680 x1847765446835712/t17179869386(17179869386) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166811 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.064272:0:31791:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55de680, transno 17179869386 00000100:00100000:3.0:1762166798.064277:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945cf3db5f80 x1847765446837120/t17179869388(17179869388) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1762166813 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_001.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166798.064284:0:31791:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869388 committed transno 17179869373 00000004:00080000:3.0:1762166798.064309:0:31791:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:0.0:1762166798.064341:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446838400:0@lo:9:umount.0 00000100:00100000:0.0:1762166798.064374:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166798.064418:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446838400 00000100:00100000:0.0:1762166798.064425:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446838400 00000100:00100000:0.0:1762166798.064458:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1762166798.064463:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3632:x1847765446838400:12345-0@lo:9:umount.0 00000020:00000080:0.0:1762166798.064501:0:8383:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb072ba 00000100:00080000:0.0:1762166798.064508:0:8383:0:(import.c:65:import_set_state_nolock()) ffff945bccb4f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1762166798.064550:0:8383:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836709 00000100:00100000:0.0:1762166798.064658:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+4:3632:x1847765446838400:12345-0@lo:9:umount.0 Request processed in 194us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166798.064665:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00010000:00010000:0.0:1762166798.064686:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1762166798.064705:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf784a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1762166798.064722:0:3632:0:(osp_dev.c:1605:osp_import_event()) got disconnected 00000004:00080000:0.0:1762166798.064723:0:3632:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:0.0:1762166798.064726:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446838400:0@lo:9:umount.0 00000004:00080000:3.0:1762166798.065955:0:10004:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 7 done 00000100:00080000:3.0:1762166798.065966:0:31791:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1762166798.065976:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945bc4175800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1762166798.066013:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 5 (ffff945cc63731b0) has no exports 00000100:00100000:0.0:1762166798.066024:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446838528:0@lo:9:umount.0 00000100:00100000:0.0:1762166798.066054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166798.066090:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446838528 00000100:00100000:0.0:1762166798.066094:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446838528 00000100:00100000:0.0:1762166798.066126:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1762166798.066134:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1847765446838528:12345-0@lo:9:umount.0 00000020:00000080:0.0:1762166798.066149:0:8380:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb07393 00000100:00080000:0.0:1762166798.066155:0:8380:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1762166798.066181:0:8380:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869388 00000100:00100000:0.0:1762166798.066282:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3632:x1847765446838528:12345-0@lo:9:umount.0 Request processed in 149us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166798.066290:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00010000:00010000:0.0:1762166798.066305:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166798.066319:0:3632:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869388 gen 3 00000100:00080000:0.0:1762166798.066323:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc4175800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1762166798.066331:0:3632:0:(osp_dev.c:1605:osp_import_event()) got disconnected 00000004:00080000:0.0:1762166798.066333:0:3632:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:0.0:1762166798.066336:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446838528:0@lo:9:umount.0 00000100:00100000:0.0:1762166798.098567:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166798.098586:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446838656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166798.098649:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166798.098688:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446838656 00000100:00100000:3.0:1762166798.098699:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446838656 00000100:00080000:0.0:1762166798.098734:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166798.098768:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1762166798.098779:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446838656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1762166798.098809:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51822272 pending 0 free 3921379328 avail 3689857024 00000100:00100000:3.0:1762166798.098859:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446838656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166798.098868:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1762166798.098896:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446838656:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1762166798.127307:0:10256:0:(genops.c:904:class_export_put()) final put ffff945cee051800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1762166798.127448:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1762166798.127501:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff945cee051800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00010000:00010000:1.0:1762166798.127523:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166798.127526:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166798.127528:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1762166798.127556:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cee057000 for lustre-MDT0000 00000020:00000080:2.0:1762166798.131426:0:10257:0:(genops.c:904:class_export_put()) final put ffff945bc81f2800/e1e11365-ba0b-405b-99c9-a704373217f2 00000020:00000080:0.0:1762166798.131466:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc81f2800/e1e11365-ba0b-405b-99c9-a704373217f2 for lustre-MDT0000 00010000:00010000:3.0:1762166798.131504:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166798.131507:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166798.131521:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1762166798.131539:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc81f5800 for lustre-MDT0000 00000100:00100000:0.0:1762166799.122785:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446838784:0@lo:400:kworker.0 00000100:00100000:1.0:1762166799.122821:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446838912:0@lo:400:kworker.0 00000100:00100000:3.0:1762166799.122844:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1847765446839040:0@lo:400:kworker.0 00000100:00100000:2.0:1762166799.122887:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446839168:0@lo:400:kworker.0 00000100:00100000:0.0:1762166799.122902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166799.122942:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166799.122958:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166799.122976:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166799.123006:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446839296:0@lo:400:kworker.0 00000100:00100000:3.0:1762166799.123007:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446839552:0@lo:400:kworker.0 00000100:00100000:2.0:1762166799.123030:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1847765446839680:0@lo:400:kworker.0 00000100:00100000:1.0:1762166799.123030:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1847765446839424:0@lo:400:kworker.0 00000100:00100000:0.0:1762166799.123057:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166799.123059:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166799.123098:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446839808:0@lo:400:kworker.0 00000100:00100000:1.0:1762166799.123108:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166799.123135:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446839040 00000100:00100000:3.0:1762166799.123141:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446839168 00000100:00100000:2.0:1762166799.123145:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446839040 00000100:00100000:0.0:1762166799.123148:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446839296 00000100:00100000:0.0:1762166799.123155:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446839296 00000100:00100000:3.0:1762166799.123156:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446839168 00000100:00100000:1.0:1762166799.123216:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446838784 00000100:00100000:1.0:1762166799.123223:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446838784 00000100:00100000:2.0:1762166799.123261:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446839552 00000100:00100000:3.0:1762166799.123268:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1762166799.123270:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446839552 00000100:00100000:0.0:1762166799.123281:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1762166799.123287:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446839168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166799.123297:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1762166799.123304:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446839296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166799.123317:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+18:3633:x1847765446838784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166799.123322:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446839424 00000100:00100000:2.0:1762166799.123332:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446839424 00000100:00100000:3.0:1762166799.123379:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446839168:12345-0@lo:400:kworker.0 Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166799.123380:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446839296:12345-0@lo:400:kworker.0 Request processed in 76us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166799.123384:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1762166799.123401:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+18:3633:x1847765446838784:12345-0@lo:400:kworker.0 Request processed in 82us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166799.123408:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1762166799.123413:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446839552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166799.123424:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1762166799.123442:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1762166799.123472:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00080000:0.0:1762166799.123503:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1762166799.123511:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166799.123542:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1847765446839040:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1762166799.123553:0:12357:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1762166799.123564:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446839552:12345-0@lo:400:kworker.0 Request processed in 153us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166799.123577:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1762166799.123589:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1847765446839424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166799.123593:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000020:00080000:1.0:1762166799.123604:0:6496:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1762166799.123614:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1847765446839040:12345-0@lo:400:kworker.0 Request processed in 64us (664us total) trans 0 rc -107/-107 00000100:00100000:3.0:1762166799.123624:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:0.0:1762166799.123636:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446838912 00000100:00100000:0.0:1762166799.123643:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446838912 00000100:00100000:1.0:1762166799.123675:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1847765446839424:12345-0@lo:400:kworker.0 Request processed in 82us (571us total) trans 0 rc -107/-107 00000100:00100000:1.0:1762166799.123689:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:0.0:1762166799.123699:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1762166799.123708:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1847765446838912:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1762166799.123720:0:6499:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1762166799.123732:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446839552:0@lo:400:kworker.0 00000100:00100000:2.0:1762166799.123734:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1762166799.123764:0:3635:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1762166799.123771:0:3634:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1762166799.123778:0:3635:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:1.0:1762166799.123781:0:3634:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1762166799.123789:0:3635:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:02000400:1.0:1762166799.123791:0:3634:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1762166799.123805:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1847765446838912:12345-0@lo:400:kworker.0 Request processed in 91us (854us total) trans 0 rc -107/-107 00000100:00080000:1.0:1762166799.123807:0:3634:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1762166799.123816:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00080000:1.0:1762166799.123818:0:3634:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 312 00000100:00100000:2.0:1762166799.123822:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446838784:0@lo:400:kworker.0 00000100:00080000:1.0:1762166799.123829:0:3634:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff945bccb4e000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1762166799.123857:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446839808 00000100:00100000:0.0:1762166799.123862:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446839808 00000100:00100000:1.0:1762166799.123870:0:3634:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc4530700 x1847765446839936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166799.123877:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446839296:0@lo:400:kworker.0 00000100:00100000:1.0:1762166799.123912:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1847765446839424:0@lo:400:kworker.0 00000100:00100000:0.0:1762166799.123918:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1762166799.123932:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446839808:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1762166799.123941:0:3634:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1762166799.123948:0:3634:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1762166799.123954:0:3634:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1762166799.123962:0:3634:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1762166799.123966:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446839936:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1762166799.123967:0:3634:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 108 00000100:00100000:0.0:1762166799.123975:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446839808:12345-0@lo:400:kworker.0 Request processed in 49us (258us total) trans 0 rc 0/0 00000100:00080000:1.0:1762166799.123977:0:3634:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff945cf35b7000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1762166799.123994:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1762166799.124010:0:3634:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc4530000 x1847765446840064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1762166799.124018:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166799.124026:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166799.124033:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446838912:0@lo:400:kworker.0 00000100:00100000:0.0:1762166799.124053:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166799.124070:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446840064:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1762166799.124095:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446839936 00000100:00100000:1.0:1762166799.124103:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446839936 00000100:00100000:0.0:1762166799.124105:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446839168:0@lo:400:kworker.0 00000100:00100000:2.0:1762166799.124120:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166799.124150:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446840064 00000100:00100000:1.0:1762166799.124151:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446839680 00000100:00100000:0.0:1762166799.124156:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446840064 00000100:00100000:1.0:1762166799.124158:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446839680 00000100:00100000:0.0:1762166799.124188:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1762166799.124195:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:0.0:1762166799.124214:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1847765446840064:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1762166799.124224:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:2.0:1762166799.124225:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446839936:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1762166799.124235:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1847765446839680:12345-0@lo:400:kworker.0 00010000:02000000:0.0:1762166799.124238:0:6499:0:(ldlm_lib.c:1191:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1762166799.124247:0:7432:0:(ldlm_lib.c:1191:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00080000:1.0:1762166799.124254:0:6496:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1762166799.124280:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446839936:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 60us (262us total) trans 0 rc -19/-19 00000100:00100000:2.0:1762166799.124287:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1762166799.124297:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1847765446839680:12345-0@lo:400:kworker.0 Request processed in 62us (246us total) trans 0 rc -107/-107 00000100:00100000:1.0:1762166799.124304:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:2.0:1762166799.124316:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446839808:0@lo:400:kworker.0 00000100:00080000:2.0:1762166799.124342:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1762166799.124347:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1762166799.124352:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446839936:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1762166799.124362:0:3636:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1762166799.124366:0:3636:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1762166799.124369:0:3636:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1762166799.124380:0:3636:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166799.124384:0:3636:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 325 00000100:00080000:1.0:1762166799.124388:0:3636:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945bc4b74800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1762166799.124401:0:3636:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc4530700 x1847765446840192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166799.124422:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1847765446839680:0@lo:400:kworker.0 00000100:00100000:2.0:1762166799.124442:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446840192:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1762166799.124461:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166799.124502:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446840192 00000100:00100000:1.0:1762166799.124508:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446840192 00000100:00100000:1.0:1762166799.124530:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:1.0:1762166799.124535:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446840192:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1762166799.124543:0:12357:0:(ldlm_lib.c:1191:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1762166799.124577:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446840192:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 40us (114us total) trans 0 rc -19/-19 00000100:00080000:2.0:1762166799.124583:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1762166799.124584:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00080000:2.0:1762166799.124589:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1762166799.124592:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446840192:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1762166799.131501:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1847765446840064:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 7273us (7358us total) trans 0 rc -19/-19 00000100:00100000:0.0:1762166799.131515:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00080000:1.0:1762166799.131547:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1762166799.131556:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1762166799.131562:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446840064:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1762166799.134741:0:3635:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1762166799.134750:0:3635:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 108 00000100:00080000:3.0:1762166799.134759:0:3635:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff945cf3704800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1762166799.134811:0:3635:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf1cd0e00 x1847765446840320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166799.134840:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1847765446839040:0@lo:400:kworker.0 00000100:00100000:1.0:1762166799.134886:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446840320:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1762166799.134972:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166799.135044:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446840320 00000100:00100000:2.0:1762166799.135055:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446840320 00000100:00100000:2.0:1762166799.135110:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:2.0:1762166799.135116:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446840320:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1762166799.135131:0:12357:0:(ldlm_lib.c:1191:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1762166799.135219:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446840320:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 102us (247us total) trans 0 rc -19/-19 00000100:00100000:2.0:1762166799.135230:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00080000:1.0:1762166799.135263:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1762166799.135270:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1762166799.135275:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446840320:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1762166799.186700:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166799.629070:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166799.629111:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166799.629141:0:6489:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440139392 00000100:00100000:2.0:1762166799.629153:0:6489:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440139392 00000100:00100000:1.0:1762166799.629158:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166799.629184:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440139520 00000100:00100000:1.0:1762166799.629190:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166799.629192:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440139520 00000100:00100000:0.0:1762166799.629233:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440139776 00000100:00100000:2.0:1762166799.629236:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 608 00000100:00100000:0.0:1762166799.629238:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440139776 00000100:00100000:3.0:1762166799.629247:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440139648 00000100:00100000:1.0:1762166799.629248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166799.629253:0:6489:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2419:x1847765440139392:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166799.629254:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440139648 00000100:00100000:0.0:1762166799.629293:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440139904 00000100:00100000:0.0:1762166799.629297:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440139904 00000100:00100000:1.0:1762166799.629305:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 263 00000100:00100000:3.0:1762166799.629306:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 426 00000100:00100000:3.0:1762166799.629321:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440139648:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166799.629323:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440139776:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166799.629340:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 264 00000100:00100000:2.0:1762166799.629346:0:6489:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2419:x1847765440139392:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166799.629358:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 608 00000100:00100000:0.0:1762166799.629358:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440139904:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166799.629371:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440139776:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 55us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166799.629384:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 263 00000100:00100000:3.0:1762166799.629385:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440139648:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 65us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166799.629396:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 426 00000100:00100000:0.0:1762166799.629402:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440139904:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166799.629411:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 264 00000100:00100000:3.0:1762166799.629418:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2875 00000100:00100000:3.0:1762166799.629423:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2418:x1847765440139520:12345-192.168.204.38@tcp:400:kworker.0 00000020:00080000:3.0:1762166799.629430:0:12357:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.38@tcp 00000100:00080000:0.0:1762166799.629440:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166799.629454:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1762166799.629458:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166799.629462:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2418:x1847765440139520:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (346us total) trans 0 rc -107/-107 00000100:00100000:3.0:1762166799.629472:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2875 00000100:00100000:2.0:1762166799.636228:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166799.636305:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440140032 00000100:00100000:1.0:1762166799.636316:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440140032 00000100:00100000:1.0:1762166799.636374:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2876 00000100:00100000:1.0:1762166799.636383:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2415:x1847765440140032:12345-192.168.204.38@tcp:38:ptlrpcd_01_00.0 00010000:02000000:1.0:1762166799.636407:0:7432:0:(ldlm_lib.c:1191:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.204.38@tcp (stopping) 00000100:00100000:1.0:1762166799.636523:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2415:x1847765440140032:12345-192.168.204.38@tcp:38:ptlrpcd_01_00.0 Request processed in 137us (305us total) trans 0 rc -19/-19 00000100:00100000:1.0:1762166799.636532:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2876 00010000:00010000:0.0:1762166800.210724:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166800.658692:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166800.658730:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446840448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1762166800.658814:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166800.658860:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446840448 00000100:00100000:3.0:1762166800.658869:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446840448 00000100:00100000:3.0:1762166800.658928:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1762166800.658941:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446840448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1762166800.658970:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3922440192 avail 3690917888 00000100:00100000:3.0:1762166800.659043:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446840448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166800.659049:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1762166800.659121:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446840448:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1762166800.659513:0:24624:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1762166800.659524:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836709 is committed 00000001:00080000:1.0:1762166800.659528:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836708 is committed 00000020:00000080:1.0:1762166800.659533:0:24624:0:(genops.c:904:class_export_put()) final put ffff945cf3d1d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1762166800.659578:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf3d1d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1762166800.659625:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bccb4f800 for lustre-OST0000 00010000:00010000:3.0:1762166801.234746:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166802.258597:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166803.218668:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446840576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1762166803.218724:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166803.218784:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446840576 00000100:00100000:0.0:1762166803.218793:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446840576 00000100:00080000:2.0:1762166803.218837:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166803.218858:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1762166803.218869:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446840576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1762166803.218896:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51822272 pending 0 free 3921379328 avail 3689857024 00000100:00100000:0.0:1762166803.218943:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446840576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166803.218951:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1762166803.218976:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446840576:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1762166803.282693:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1762166803.731527:0:25941:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1762166803.731533:0:25941:0:(genops.c:904:class_export_put()) final put ffff945bc2dcf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1762166803.731580:0:36:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc2dcf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00080000:1.0:1762166803.731618:0:6475:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 52 batchid updated 00000001:00100000:2.0:1762166803.731639:0:7412:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1762166803.731639:0:36:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc4b74000 for lustre-OST0001 00000020:00080000:3.0:1762166803.731646:0:6526:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc4033840 refcount 1 committed 1 result 0 batchid 52 00000001:00080000:2.0:1762166803.731650:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967470 is committed 00000020:00080000:3.0:1762166803.731654:0:6526:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccc6b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc6399c00 00000020:00000080:2.0:1762166803.731654:0:7412:0:(genops.c:904:class_export_put()) final put ffff945cf3949000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1762166803.731662:0:6526:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccc6b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4033000 00000020:00080000:3.0:1762166803.731665:0:6526:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccc6ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3b92200 00000020:00080000:3.0:1762166803.731669:0:6526:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].29 00000020:00000080:1.0:1762166803.731674:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf3949000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1762166803.731744:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cee00a800 for lustre-MDT0001 00000040:00080000:2.0:1762166803.732412:0:31791:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 0, last_idx 2 00000040:00080000:2.0:1762166803.732463:0:31791:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 1, last_idx 2 00000020:00080000:2.0:1762166803.732628:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 5 (ffff945cc63731b0) has no exports 00000020:00000080:2.0:1762166803.758457:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcbf5 00000020:00000080:2.0:1762166803.758471:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf1c57800/lustre-QMT0000_UUID 00000020:01000000:2.0:1762166803.758508:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1762166803.758530:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf1c57800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1762166803.758533:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1762166803.758544:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1762166803.758549:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 7 (ffff945cc6376360) has no exports 00000020:00000080:2.0:1762166803.758749:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcbee 00000020:00000080:2.0:1762166803.758754:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf1c54000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1762166803.758837:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf1c54000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1762166803.758848:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1762166803.758857:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1762166803.758860:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf1c55000/lustre-QMT0000_UUID 00000020:00000080:3.0:1762166803.758863:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf1c55000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1762166803.758868:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1762166803.758993:0:31791:0:(lprocfs_status_server.c:299:lprocfs_free_client_stats()) stat ffff945bc45bfc60 - data ffff945bc303abd0/ffff945bc2d49800 00000020:01000000:3.0:1762166803.759101:0:31791:0:(lprocfs_status_server.c:299:lprocfs_free_client_stats()) stat ffff945cd12df480 - data ffff945cd142d288/ffff945cc34e8c00 00000100:00080000:1.0:1762166803.792868:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1762166803.792883:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967469 gen 4 00000100:00100000:1.0:1762166803.792898:0:31791:0:(client.c:3109:ptlrpc_free_committed()) @@@ free request with old gen req@ffff945cf1cd1880 x1847765446838144/t4294967470(4294967470) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1762166808 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166803.792921:0:31791:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1762166803.794090:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1762166803.794094:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836704 gen 4 00000004:00080000:1.0:1762166803.794112:0:31791:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:1.0:1762166803.794114:0:31791:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1762166803.794316:0:9163:0:(osp_sync.c:1253:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1762166803.794320:0:9163:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 131 count 2 00000040:00080000:2.0:1762166803.794328:0:9163:0:(llog.c:854:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1762166803.794583:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1762166803.794587:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869388 gen 4 00000004:00080000:1.0:1762166803.794596:0:31791:0:(osp_dev.c:1621:osp_import_event()) got inactive 00000100:00100000:1.0:1762166803.794598:0:31791:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1762166803.794757:0:10004:0:(osp_sync.c:1253:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1762166803.794761:0:10004:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 124 count 8 00000040:00080000:3.0:1762166803.794767:0:10004:0:(llog.c:854:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1762166803.795272:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcbbd 00000020:00000080:1.0:1762166803.795280:0:31791:0:(genops.c:904:class_export_put()) final put ffff945d00f74000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1762166803.795307:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945d00f74000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1762166803.797467:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcbd2 00000020:00000080:1.0:1762166803.797491:0:31791:0:(genops.c:904:class_export_put()) final put ffff945d00f76800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1762166803.797501:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1762166803.797506:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166803.797514:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1762166803.797517:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945d00f76800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00080000:1.0:1762166803.797523:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 4 (ffff945cc63718d8) has no exports 00000004:01000000:1.0:1762166803.797750:0:31791:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1762166803.797758:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafd008 00000020:00000080:1.0:1762166803.797763:0:31791:0:(genops.c:904:class_export_put()) final put ffff945bc4387000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1762166803.797792:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1762166803.797796:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166803.797806:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1762166803.797809:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc4387000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00080000:1.0:1762166803.797810:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 28 (ffff945bc40b6360) has no exports 00000020:00000080:1.0:1762166803.797819:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafd001 00000020:00000080:1.0:1762166803.797824:0:31791:0:(genops.c:904:class_export_put()) final put ffff945bc4177000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1762166803.797840:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc4177000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1762166803.798341:0:31791:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1762166803.798345:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1762166803.798356:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869388 gen 5 00000100:00020000:1.0:1762166803.798361:0:31791:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup 00000100:00100000:1.0:1762166803.803706:0:31791:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:1.0:1762166803.803712:0:31791:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup 00000020:00000080:3.0:1762166803.803764:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc4175800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1762166803.803784:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166803.803800:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166803.803806:0:31791:0:(genops.c:904:class_export_put()) final put ffff945bc4380000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1762166803.803810:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc4380000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1762166803.803817:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166803.803921:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcec6 00000020:00000080:1.0:1762166803.803929:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf78a3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1762166803.803943:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1762166803.803949:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166803.803956:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1762166803.803960:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf78a3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00080000:1.0:1762166803.803961:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 22 (ffff945cc7c1e360) has no exports 00000020:00000080:1.0:1762166803.803970:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcebf 00000020:00000080:1.0:1762166803.803974:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf784b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1762166803.803990:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf784b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1762166803.804597:0:31791:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1762166803.804601:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1762166803.804605:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836704 gen 5 00000100:00020000:1.0:1762166803.804610:0:31791:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup 00000100:00100000:1.0:1762166803.804611:0:31791:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:1.0:1762166803.804614:0:31791:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup 00000020:00000080:3.0:1762166803.804637:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cf784a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1762166803.804661:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1762166803.804669:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166803.804673:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf4173800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1762166803.804676:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf4173800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1762166803.804684:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1762166803.804739:0:31791:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1762166803.804748:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcd8b 00000020:00000080:1.0:1762166803.804753:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cff201000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1762166803.804765:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1762166803.804774:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cff201000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1762166803.804775:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1762166803.804782:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1762166803.804785:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 15 (ffff945cc7ba18d8) has no exports 00000020:00000080:1.0:1762166803.804790:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcd84 00000020:00000080:1.0:1762166803.804794:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cff202800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1762166803.804810:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cff202800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1762166803.806403:0:31791:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1762166803.806408:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1762166803.806411:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967469 gen 5 00000100:00020000:2.0:1762166803.806415:0:31791:0:(obd_class.h:479:obd_check_dev()) Device 15 not setup 00000100:00100000:2.0:1762166803.806417:0:31791:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:2.0:1762166803.806420:0:31791:0:(obd_class.h:479:obd_check_dev()) Device 15 not setup 00000020:00000080:3.0:1762166803.806450:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cff205000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1762166803.806469:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1762166803.806502:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1762166803.806509:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cc4d75000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1762166803.806512:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945cc4d75000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1762166803.806518:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1762166803.806614:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1762166803.806618:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1762166803.806622:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cc7ca8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1762166803.806624:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945cc7ca8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1762166803.806629:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1762166803.806703:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcbd9 00000020:00000080:2.0:1762166803.806709:0:31791:0:(genops.c:904:class_export_put()) final put ffff945d00f76000/lustre-MDD0000_UUID 00000020:01000000:2.0:1762166803.806726:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1762166803.806730:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1762166803.806735:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945d00f76000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1762166803.806738:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1762166803.806742:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 6 (ffff945cc6374a88) has no exports 00000020:00000080:2.0:1762166803.806866:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1762166803.806872:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1762166803.806875:0:31791:0:(genops.c:904:class_export_put()) final put ffff945d00f70000/lustre-MDD0000_UUID 00000020:00000080:2.0:1762166803.806877:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945d00f70000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1762166803.806881:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1762166803.806912:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcbe0 00000020:00000080:2.0:1762166803.806917:0:31791:0:(genops.c:904:class_export_put()) final put ffff945d00f72000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1762166803.806936:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945d00f72000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1762166803.806936:0:31791:0:(tgt_mount.c:188:server_put_mount()) put mount ffff945cc5450800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1762166803.806943:0:31791:0:(obd_mount.c:705:lustre_put_lsi()) put ffff945cc5450800 3 00000020:01000004:2.0:1762166803.806947:0:31791:0:(tgt_mount.c:121:server_deregister_mount()) deregister mount ffff945cc5450800 from lustre-MDT0000 00000020:00000080:2.0:1762166803.806980:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1762166803.806984:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1762166803.806990:0:31791:0:(genops.c:904:class_export_put()) final put ffff945d00f77800/lustre-MDT0000_UUID 00000020:00000080:2.0:1762166803.806992:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945d00f77800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1762166803.807000:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1762166803.807029:0:31791:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1762166803.807034:0:31791:0:(tgt_mount.c:256:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1762166803.807036:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1762166803.807039:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1762166803.807042:0:31791:0:(obd_config.c:886:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1762166803.807053:0:31791:0:(genops.c:1836:print_export_data()) MGS: ACTIVE ffff945bc4bb6800 cc359222-7391-43f5-989b-bf5867ae8fd6 192.168.204.38@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1762166803.807059:0:31791:0:(genops.c:1836:print_export_data()) MGS: ACTIVE ffff945cd42f7000 d5309af7-bf8a-40d1-8f22-842c4953c1ea 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1762166803.807063:0:31791:0:(genops.c:1570:class_disconnect_exports()) OBD device 1 (ffff945cc7c198d8) has exports, disconnecting them 00000020:00080000:2.0:1762166803.807068:0:31791:0:(genops.c:1545:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.38@tcp (ffff945bc4bb6800), last request at 1762166763 00000020:00000080:2.0:1762166803.807079:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effb0b502 00000020:00010000:2.0:1762166803.807083:0:31791:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945bc4bb6800: total 0 00000100:00080000:2.0:1762166803.807086:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945bc4bb5800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1762166803.807109:0:31791:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 192.168.204.38@tcp (ffff945bc4bb6800): rc 0 00000020:00080000:2.0:1762166803.807114:0:31791:0:(genops.c:1545:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff945cd42f7000), last request at 1762166481 00000020:00010000:3.0:1762166803.807124:0:7420:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945bc4bb6800: total 0 00000020:00000080:2.0:1762166803.807131:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcb7e 00000020:00010000:2.0:1762166803.807139:0:31791:0:(genops.c:1938:obd_stale_export_put()) Put export ffff945cd42f7000: total 0 00000100:00080000:2.0:1762166803.807142:0:31791:0:(import.c:65:import_set_state_nolock()) ffff945cd42f6800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1762166803.807158:0:31791:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff945cd42f7000): rc 0 00000020:00080000:2.0:1762166803.807163:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 1 (ffff945cc7c198d8) has no exports 00000020:00010000:0.0:1762166803.807164:0:6482:0:(genops.c:1924:obd_stale_export_get()) Get export ffff945cd42f7000: total 0 00010000:00010000:3.0:1762166803.807181:0:7420:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945bc4bb6800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1762166803.807218:0:6482:0:(ldlm_lock.c:2645:ldlm_export_cancel_blocked_locks()) Export ffff945cd42f7000, canceled 0 locks, left on hash table 13. 00000100:00100000:2.0:1762166803.807244:0:6489:0:(service.c:3155:ptlrpc_main()) ll_mgs_0002: service thread [ffff945cc7b91800:6489] 2 exiting: rc = 0 00010000:00010000:0.0:1762166803.807254:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc3d4b000/0x2f180c4effafcc88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafcc81 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166803.807256:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc29ca800/0x2f180c4effb0b517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7925 expref: 5 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166803.807294:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bc60b0400/0x2f180c4effb0729e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb07297 expref: 13 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166803.807307:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc29cb800/0x2f180c4effb0b510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78f4 expref: 4 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166803.807312:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cf786ac00/0x2f180c4effafd0c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafd0be expref: 12 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166803.807334:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc29cba00/0x2f180c4effb0b509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b78ed expref: 3 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166803.807339:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cf3dc6800/0x2f180c4effb072dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb072d6 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166803.807362:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc29ca000/0x2f180c4effb0b51e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b792c expref: 2 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166803.807366:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc29ca400/0x2f180c4effafcc7a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafcc73 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166803.807376:0:7420:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945bc4bb6800, canceled 4 locks, left on hash table 0. 00000100:00100000:2.0:1762166803.807390:0:6487:0:(service.c:3155:ptlrpc_main()) ll_mgs_0000: service thread [ffff945cc7dc9000:6487] 0 exiting: rc = 1 00010000:00010000:0.0:1762166803.807396:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc13fda00/0x2f180c4effb073a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb073a1 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166803.807413:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb07377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb07370 expref: 8 pid: 6487 timeout: 0 lvb_type: 0 00000020:00000080:3.0:1762166803.807417:0:7420:0:(genops.c:904:class_export_put()) final put ffff945bc4bb6800/cc359222-7391-43f5-989b-bf5867ae8fd6 00010000:00010000:0.0:1762166803.807430:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bccb89a00/0x2f180c4effb073b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb073af expref: 7 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166803.807435:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166803.807440:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166803.807444:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bcc9e2600/0x2f180c4effb073f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb073ee expref: 6 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166803.807445:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1762166803.807452:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945bc4bb6800/cc359222-7391-43f5-989b-bf5867ae8fd6 for MGS 00010000:00010000:0.0:1762166803.807461:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cf786b400/0x2f180c4effafd0ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafd0e8 expref: 5 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166803.807475:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cf3cad600/0x2f180c4effafd17b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafd174 expref: 4 pid: 6487 timeout: 0 lvb_type: 0 00000020:00000080:2.0:1762166803.807499:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945bc4bb5800 for MGS 00010000:00010000:0.0:1762166803.807529:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945cc29caa00/0x2f180c4effafd0b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effafd0b0 expref: 3 pid: 6487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166803.807547:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bc37b7000/0x2f180c4effb072cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb072c8 expref: 2 pid: 6489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166803.807562:0:6482:0:(ldlm_lock.c:2673:ldlm_export_cancel_locks()) Export ffff945cd42f7000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1762166803.807583:0:6482:0:(genops.c:904:class_export_put()) final put ffff945cd42f7000/d5309af7-bf8a-40d1-8f22-842c4953c1ea 00010000:00010000:0.0:1762166803.807594:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166803.807597:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166803.807600:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1762166803.807602:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cd42f7000/d5309af7-bf8a-40d1-8f22-842c4953c1ea for MGS 00000020:00000080:2.0:1762166803.807626:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cd42f6800 for MGS 00000100:00100000:1.0:1762166803.807655:0:6488:0:(service.c:3155:ptlrpc_main()) ll_mgs_0001: service thread [ffff945cc7ac2e00:6488] 1 exiting: rc = 0 00000100:00100000:2.0:1762166803.807704:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807714:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807721:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807727:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807733:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807738:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807744:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807749:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807754:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807760:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807765:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807770:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807775:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807780:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807786:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807790:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807796:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807801:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807806:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807815:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807820:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807827:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807832:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807843:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807849:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807854:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807859:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807865:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807870:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807874:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807880:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807884:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807889:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807895:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807899:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807904:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807909:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807914:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807919:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807923:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807928:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807933:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807938:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807943:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807947:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807952:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807956:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807961:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807966:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807971:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807988:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807993:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.807998:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808009:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808021:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808027:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808032:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808038:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808043:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808048:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808052:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808057:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808062:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1762166803.808066:0:31791:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1762166803.808600:0:31791:0:(lprocfs_status_server.c:299:lprocfs_free_client_stats()) stat ffff945bc3632f00 - data ffff945cf91a6360/ffff945bc47bc400 00000020:01000000:2.0:1762166803.808682:0:31791:0:(lprocfs_status_server.c:299:lprocfs_free_client_stats()) stat ffff945cc6749d20 - data ffff945cf9116870/ffff945cc7b14000 00000020:00000080:2.0:1762166803.809032:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcb62 00000020:00000080:2.0:1762166803.809037:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cc7cab000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1762166803.809048:0:31791:0:(tgt_mount.c:188:server_put_mount()) put mount ffff945cc5450800 from MGS, refs=2 00000020:01000004:2.0:1762166803.809050:0:31791:0:(obd_mount.c:705:lustre_put_lsi()) put ffff945cc5450800 2 00000020:01000004:2.0:1762166803.809053:0:31791:0:(tgt_mount.c:121:server_deregister_mount()) deregister mount ffff945cc5450800 from MGS 00000020:00000080:2.0:1762166803.809072:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1762166803.809073:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cc7cab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1762166803.809077:0:31791:0:(obd_config.c:814:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1762166803.809081:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cc7ca8000/MGS 00000020:00000080:2.0:1762166803.809083:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945cc7ca8000/MGS for MGS 00000020:01000000:2.0:1762166803.809089:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1762166803.809145:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1762166803.809149:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1762166803.809152:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1762166803.809156:0:31791:0:(genops.c:1836:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff945cf1c58800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1762166803.809160:0:31791:0:(genops.c:1570:class_disconnect_exports()) OBD device 8 (ffff945cf1d8b1b0) has exports, disconnecting them 00000020:00080000:2.0:1762166803.809164:0:31791:0:(genops.c:1545:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff945cf1c58800), last request at 1762166481 00000020:00000080:2.0:1762166803.809167:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcc2d 00000020:00080000:2.0:1762166803.809175:0:31791:0:(genops.c:1550:class_disconnect_export_list()) disconnected export at 0@lo (ffff945cf1c58800): rc 0 00000020:00000080:2.0:1762166803.809178:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf1c58800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1762166803.809211:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf1c58800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1762166803.811301:0:31791:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1762166803.811313:0:31791:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1762166803.811317:0:31791:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00020000:2.0:1762166803.811321:0:31791:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup 00000100:00100000:2.0:1762166803.811323:0:31791:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:2.0:1762166803.811326:0:31791:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup 00000020:00000080:3.0:1762166803.811349:0:37:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff945cf1c58000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1762166803.811425:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1762166803.811432:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1762166803.811435:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cf1c5f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1762166803.811438:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945cf1c5f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1762166803.811443:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1762166803.811786:0:31791:0:(obd_mount.c:705:lustre_put_lsi()) put ffff945cc5450800 1 00000020:00000080:2.0:1762166803.811791:0:31791:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2f180c4effafcb54 00000020:00000080:2.0:1762166803.811797:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cc7cab800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1762166803.811810:0:31791:0:(obd_config.c:2357:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1762166803.811814:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1762166803.811818:0:31791:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:3.0:1762166803.811820:0:37:0:(genops.c:863:class_export_destroy()) destroying export ffff945cc7cab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1762166803.811822:0:31791:0:(genops.c:1575:class_disconnect_exports()) OBD device 0 (ffff945cc7c18000) has no exports 00000020:00000080:2.0:1762166803.829804:0:31791:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1762166803.829816:0:31791:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1762166803.829821:0:31791:0:(genops.c:904:class_export_put()) final put ffff945cd19e6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1762166803.829826:0:31791:0:(genops.c:863:class_export_destroy()) destroying export ffff945cd19e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1762166803.829832:0:31791:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1762166803.829934:0:31791:0:(obd_mount.c:637:lustre_free_lsi()) Freeing lsi ffff945cd19e5800 00000020:02000400:2.0:1762166803.829999:0:31791:0:(tgt_mount.c:2025:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1762166804.242633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1762166804.242640:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1762166804.242645:0:36:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1762166804.242655:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 418 00000100:00080000:2.0:1762166804.242662:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1762166804.242666:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446840704:0@lo:400:kworker.0 00000100:00080000:2.0:1762166804.242673:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff945cf35b7000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1762166804.242726:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc58cf480 x1847765446840832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1762166804.242753:0:3636:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1847765446840704 offset 0 length 224: 4 00000100:00080000:2.0:1762166804.242758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1762166804.242763:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1762166804.242767:0:36:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1762166804.242773:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 418 00000100:00080000:2.0:1762166804.242778:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1762166804.242784:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff945cf3704800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1762166804.242785:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446840832:0@lo:38:kworker.0 00000100:00100000:2.0:1762166804.242805:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc2d5ed80 x1847765446840960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1762166804.242874:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1762166804.242875:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166804.242880:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446841216:0@lo:400:kworker.0 00000100:00100000:0.0:1762166804.242884:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446841088:0@lo:400:kworker.0 00000100:00080000:2.0:1762166804.242892:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1762166804.242898:0:36:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1762166804.242908:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 418 00000100:00080000:2.0:1762166804.242917:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1762166804.242923:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff945bccb4e000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1762166804.242944:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446840960:0@lo:38:kworker.0 00000100:00100000:2.0:1762166804.242945:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc2d5ce00 x1847765446841344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166804.242955:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446840832 00000100:00100000:1.0:1762166804.242959:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166804.242978:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446840832 00000100:00080000:2.0:1762166804.243003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1762166804.243009:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1762166804.243011:0:36:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1762166804.243019:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 418 00000100:00100000:3.0:1762166804.243023:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1762166804.243027:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1762166804.243033:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00080000:2.0:1762166804.243036:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945bc4b74800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1762166804.243049:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1847765446840832:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1762166804.243064:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446841344:0@lo:38:kworker.0 00000100:00100000:2.0:1762166804.243068:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc4a2b100 x1847765446841600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166804.243069:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446840960 00010000:00020000:0.0:1762166804.243075:0:6499:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1762166804.243078:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446840960 00000100:00100000:3.0:1762166804.243129:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166804.243145:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446841344 00000100:00100000:2.0:1762166804.243152:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446841472:0@lo:400:kworker.0 00000100:00100000:1.0:1762166804.243155:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446841344 00000100:00100000:3.0:1762166804.243165:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446841600:0@lo:38:kworker.0 00000100:00100000:1.0:1762166804.243193:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1762166804.243211:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166804.243213:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446840960:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1762166804.243219:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446841216 00000100:00100000:3.0:1762166804.243227:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446841216 00010000:00020000:1.0:1762166804.243232:0:7432:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1762166804.243238:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1762166804.243246:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446841728:0@lo:400:kworker.0 00000100:00100000:3.0:1762166804.243289:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1762166804.243296:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166804.243301:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446841216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166804.243312:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446840960:12345-0@lo:38:kworker.0 Request processed in 101us (287us total) trans 0 rc -19/-19 00000100:00100000:1.0:1762166804.243323:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1762166804.243344:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446841472 00000100:00100000:2.0:1762166804.243351:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446841472 00000100:00100000:1.0:1762166804.243353:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446841728 00000100:00100000:1.0:1762166804.243359:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446841728 00000100:00100000:3.0:1762166804.243364:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446841216:12345-0@lo:400:kworker.0 Request processed in 66us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166804.243373:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1762166804.243409:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1762166804.243420:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1762166804.243426:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446841472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166804.243443:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166804.243444:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446841728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166804.243511:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446841472:12345-0@lo:400:kworker.0 Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166804.243519:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00080000:3.0:1762166804.243525:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1762166804.243534:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1762166804.243543:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446840960:0@lo:38:kworker.0 00000100:00100000:2.0:1762166804.243545:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446841600 00000100:00100000:2.0:1762166804.243552:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446841600 00000100:00100000:1.0:1762166804.243559:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446841728:12345-0@lo:400:kworker.0 Request processed in 122us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166804.243571:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1762166804.243586:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:2.0:1762166804.243594:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446841344:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1762166804.243608:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00010000:00020000:2.0:1762166804.243612:0:6494:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1762166804.243619:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446841600:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1762166804.243634:0:7432:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1762166804.243658:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446841344:12345-0@lo:38:kworker.0 Request processed in 61us (548us total) trans 0 rc -19/-19 00000100:00100000:2.0:1762166804.243669:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:1.0:1762166804.243681:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446841600:12345-0@lo:38:kworker.0 Request processed in 59us (242us total) trans 0 rc -19/-19 00000100:00100000:1.0:1762166804.243692:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:2.0:1762166804.243722:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446841728:0@lo:400:kworker.0 00000100:00080000:3.0:1762166804.243734:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1762166804.243743:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166804.243746:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446841472:0@lo:400:kworker.0 00000100:00100000:1.0:1762166804.243775:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1762166804.243778:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1762166804.243783:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1762166804.243788:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446841600:0@lo:38:kworker.0 00000100:00080000:3.0:1762166804.243804:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1762166804.243807:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1762166804.243811:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446841344:0@lo:38:kworker.0 00000100:00100000:1.0:1762166804.243846:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446841088 00000100:00100000:1.0:1762166804.243853:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446841088 00000100:00100000:3.0:1762166804.243879:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446841216:0@lo:400:kworker.0 00000100:00100000:1.0:1762166804.243900:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1762166804.243911:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446841088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166804.243960:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446841088:12345-0@lo:400:kworker.0 Request processed in 52us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166804.243967:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1762166804.244005:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446841088:0@lo:400:kworker.0 00000100:00100000:0.0:1762166804.250587:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1847765446840832:12345-0@lo:38:kworker.0 Request processed in 7538us (7714us total) trans 0 rc -19/-19 00000100:00100000:0.0:1762166804.250601:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00080000:3.0:1762166804.250634:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1762166804.250647:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1762166804.250651:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446840832:0@lo:38:kworker.0 00010000:00010000:3.0:1762166804.306584:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1762166804.748973:0:3626:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.204.38@tcp portal 26 match 1847765440140160 offset 0 length 224: 4 00000100:00100000:2.0:1762166804.749031:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166804.749078:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166804.749133:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440140416 00000100:00100000:2.0:1762166804.749134:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166804.749146:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440140416 00000100:00100000:3.0:1762166804.749166:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440140544 00000100:00100000:3.0:1762166804.749180:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440140544 00000100:00100000:2.0:1762166804.749187:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166804.749215:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440140288 00000100:00100000:0.0:1762166804.749223:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440140288 00000100:00100000:2.0:1762166804.749227:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440140672 00000100:00100000:2.0:1762166804.749233:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440140672 00000100:00100000:1.0:1762166804.749249:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 429 00000100:00100000:1.0:1762166804.749270:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440140416:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166804.749285:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 267 00000100:00100000:0.0:1762166804.749286:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2880 00000100:00100000:2.0:1762166804.749299:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 268 00000100:00100000:0.0:1762166804.749306:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2415:x1847765440140288:12345-192.168.204.38@tcp:38:kworker.0 00000100:00100000:3.0:1762166804.749308:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440140544:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166804.749315:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440140672:12345-192.168.204.38@tcp:400:kworker.0 00010000:00020000:0.0:1762166804.749335:0:6496:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1762166804.749357:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440140416:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166804.749364:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440140672:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 55us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166804.749366:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2415:x1847765440140288:12345-192.168.204.38@tcp:38:kworker.0 Request processed in 67us (234us total) trans 0 rc -19/-19 00000100:00100000:1.0:1762166804.749372:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 429 00000100:00100000:2.0:1762166804.749379:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 268 00000100:00100000:0.0:1762166804.749383:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2880 00000100:00100000:3.0:1762166804.749407:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440140544:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 103us (322us total) trans 0 rc 0/0 00000100:00080000:1.0:1762166804.749413:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166804.749421:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 267 00000100:00080000:1.0:1762166804.749421:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1762166804.749432:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1762166805.330663:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166805.778736:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446841856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1762166805.778808:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166805.778866:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446841856 00000100:00100000:0.0:1762166805.778879:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446841856 00000100:00100000:0.0:1762166805.778936:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1762166805.778947:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446841856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1762166805.778978:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3922440192 avail 3690917888 00000100:00100000:0.0:1762166805.779026:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446841856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166805.779035:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1762166805.779067:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446841856:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1762166806.354685:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166807.378728:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166808.338649:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446841984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166808.338718:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166808.338776:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446841984 00000100:00100000:0.0:1762166808.338784:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446841984 00000100:00080000:1.0:1762166808.338822:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166808.338840:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1762166808.338848:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446841984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1762166808.338879:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51822272 pending 0 free 3921379328 avail 3689857024 00000100:00100000:0.0:1762166808.338919:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446841984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166808.338925:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1762166808.338965:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446841984:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1762166808.402663:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1762166809.362666:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166809.362674:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166809.362679:0:37:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166809.362688:0:37:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 423 00000100:00100000:2.0:1762166809.362695:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446842112:0@lo:400:kworker.0 00000100:00080000:1.0:1762166809.362696:0:37:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1762166809.362706:0:37:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff945cf35b7000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1762166809.362737:0:37:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc5bb9500 x1847765446842240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1762166809.362760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166809.362765:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166809.362767:0:37:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000400:00000100:2.0:1762166809.362771:0:3635:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1847765446842112 offset 0 length 224: 4 00000100:00080000:1.0:1762166809.362774:0:37:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1762166809.362779:0:37:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1762166809.362784:0:37:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff945cf3704800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1762166809.362801:0:37:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc4947800 x1847765446842368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166809.362837:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446842240:0@lo:38:kworker.0 00000100:00100000:2.0:1762166809.362849:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1762166809.362858:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446842496:0@lo:400:kworker.0 00000100:00080000:1.0:1762166809.362862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166809.362866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166809.362869:0:37:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166809.362873:0:37:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1762166809.362876:0:37:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1762166809.362881:0:37:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff945bccb4e000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1762166809.362892:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166809.362897:0:37:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc4945500 x1847765446842752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166809.362899:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166809.362924:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446842240 00000100:00100000:3.0:1762166809.362929:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446842368:0@lo:38:kworker.0 00000100:00100000:0.0:1762166809.362934:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446842240 00000100:00080000:1.0:1762166809.362939:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1762166809.362941:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446842496 00000100:00080000:1.0:1762166809.362943:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1762166809.362946:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446842496 00000100:00080000:1.0:1762166809.362946:0:37:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166809.362951:0:37:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1762166809.362955:0:37:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1762166809.362958:0:37:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945bc4b74800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1762166809.362972:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166809.362976:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1762166809.362980:0:37:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc4944a80 x1847765446843008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166809.362996:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1762166809.362997:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1847765446842240:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1762166809.363001:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446842752:0@lo:38:kworker.0 00000100:00100000:2.0:1762166809.363009:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446842496:12345-0@lo:400:kworker.0 00010000:00020000:0.0:1762166809.363032:0:6499:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1762166809.363052:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166809.363066:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166809.363079:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446843136:0@lo:400:kworker.0 00000100:00100000:2.0:1762166809.363086:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446842496:12345-0@lo:400:kworker.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166809.363086:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1847765446842240:12345-0@lo:38:kworker.0 Request processed in 100us (195us total) trans 0 rc -19/-19 00000100:00100000:3.0:1762166809.363087:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446843008:0@lo:38:kworker.0 00000100:00100000:0.0:1762166809.363100:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1762166809.363101:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1762166809.363124:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166809.363128:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446842624:0@lo:400:kworker.0 00000100:00100000:0.0:1762166809.363136:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446842368 00000100:00100000:0.0:1762166809.363139:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446842368 00000100:00100000:0.0:1762166809.363164:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446842752 00000100:00100000:0.0:1762166809.363167:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446842752 00000100:00100000:1.0:1762166809.363171:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446842880:0@lo:400:kworker.0 00000100:00100000:2.0:1762166809.363172:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166809.363180:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446842496:0@lo:400:kworker.0 00000100:00100000:0.0:1762166809.363183:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446843136 00000100:00100000:0.0:1762166809.363188:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446843136 00000100:00100000:1.0:1762166809.363206:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166809.363220:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446842624 00000100:00100000:0.0:1762166809.363221:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446842880 00000100:00100000:2.0:1762166809.363224:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446842624 00000100:00100000:0.0:1762166809.363224:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446842880 00000100:00100000:3.0:1762166809.363248:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1762166809.363253:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1762166809.363255:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1762166809.363262:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446843136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166809.363267:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:0.0:1762166809.363268:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446842880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166809.363269:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446842624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166809.363278:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446842368:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1762166809.363288:0:7432:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1762166809.363337:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446842624:12345-0@lo:400:kworker.0 Request processed in 72us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166809.363339:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446842880:12345-0@lo:400:kworker.0 Request processed in 79us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166809.363345:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1762166809.363346:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1762166809.363353:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446842368:12345-0@lo:38:kworker.0 Request processed in 73us (382us total) trans 0 rc -19/-19 00000100:00100000:3.0:1762166809.363356:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446843136:12345-0@lo:400:kworker.0 Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166809.363363:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1762166809.363376:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446842752:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1762166809.363377:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:2.0:1762166809.363380:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446842624:0@lo:400:kworker.0 00000100:00100000:3.0:1762166809.363387:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00010000:00020000:0.0:1762166809.363395:0:12357:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1762166809.363406:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166809.363412:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166809.363427:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166809.363430:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446842752:12345-0@lo:38:kworker.0 Request processed in 54us (378us total) trans 0 rc -19/-19 00000100:00100000:3.0:1762166809.363435:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446843136:0@lo:400:kworker.0 00000100:00100000:0.0:1762166809.363441:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:1.0:1762166809.363453:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446843008 00000100:00100000:1.0:1762166809.363459:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446843008 00000100:00080000:2.0:1762166809.363464:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1762166809.363470:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1762166809.363496:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446842240:0@lo:38:kworker.0 00000100:00100000:0.0:1762166809.363501:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446842880:0@lo:400:kworker.0 00000100:00080000:2.0:1762166809.363510:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1762166809.363511:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00080000:2.0:1762166809.363519:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1762166809.363520:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1847765446843008:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1762166809.363526:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446842368:0@lo:38:kworker.0 00010000:00020000:1.0:1762166809.363536:0:6496:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1762166809.363549:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1762166809.363556:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1762166809.363561:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1847765446843008:12345-0@lo:38:kworker.0 Request processed in 40us (134us total) trans 0 rc -19/-19 00000100:00100000:2.0:1762166809.363562:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446842752:0@lo:38:kworker.0 00000100:00100000:1.0:1762166809.363569:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00080000:2.0:1762166809.363585:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1762166809.363593:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1762166809.363596:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446843008:0@lo:38:kworker.0 00010000:00010000:3.0:1762166809.426691:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1762166809.868972:0:3628:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.204.38@tcp portal 26 match 1847765440140800 offset 0 length 224: 4 00000100:00100000:2.0:1762166809.869021:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166809.869050:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166809.869073:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166809.869094:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166809.869094:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440140928 00000100:00100000:1.0:1762166809.869105:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440140928 00000100:00100000:2.0:1762166809.869116:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440141184 00000100:00100000:2.0:1762166809.869121:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440141184 00000100:00100000:0.0:1762166809.869130:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440141056 00000100:00100000:0.0:1762166809.869137:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440141056 00000100:00100000:3.0:1762166809.869158:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2884 00000100:00100000:2.0:1762166809.869165:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440141312 00000100:00100000:3.0:1762166809.869170:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2415:x1847765440140928:12345-192.168.204.38@tcp:38:kworker.0 00000100:00100000:1.0:1762166809.869179:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 432 00000100:00100000:2.0:1762166809.869183:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440141312 00010000:00020000:3.0:1762166809.869194:0:6495:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1762166809.869197:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440141056:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:0.0:1762166809.869213:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166809.869219:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166809.869222:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 271 00000100:00080000:0.0:1762166809.869223:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166809.869236:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440141184:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166809.869254:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 272 00000100:00100000:3.0:1762166809.869262:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2415:x1847765440140928:12345-192.168.204.38@tcp:38:kworker.0 Request processed in 90us (237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1762166809.869263:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440141056:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166809.869269:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2416:x1847765440141312:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166809.869276:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440141184:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166809.869282:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2884 00000100:00100000:2.0:1762166809.869291:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 271 00000100:00100000:1.0:1762166809.869293:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 432 00000100:00100000:0.0:1762166809.869310:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2416:x1847765440141312:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166809.869319:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 272 00010000:00010000:1.0:1762166810.450607:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166810.898677:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446843264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166810.898763:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166810.898811:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446843264 00000100:00100000:0.0:1762166810.898819:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446843264 00000100:00100000:0.0:1762166810.898869:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1762166810.898880:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446843264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1762166810.898905:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3922440192 avail 3690917888 00000100:00100000:0.0:1762166810.898946:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446843264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166810.898951:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1762166810.899013:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446843264:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1762166811.474663:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166812.498647:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166813.458652:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166813.458672:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446843392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166813.458724:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166813.458788:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446843392 00000100:00100000:0.0:1762166813.458798:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446843392 00000100:00080000:1.0:1762166813.458844:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166813.458864:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1762166813.458889:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446843392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1762166813.458920:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51822272 pending 0 free 3921379328 avail 3689857024 00000100:00100000:0.0:1762166813.458998:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446843392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166813.459006:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1762166813.459027:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446843392:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1762166813.522691:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1762166814.482679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166814.482686:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166814.482689:0:37:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166814.482699:0:37:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1762166814.482720:0:37:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1762166814.482730:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1762166814.482730:0:37:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff945cf35b7000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1762166814.482756:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446843520:0@lo:400:kworker.0 00000100:00100000:1.0:1762166814.482760:0:37:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc494d500 x1847765446843648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1762166814.482796:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166814.482800:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166814.482802:0:37:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166814.482805:0:37:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1762166814.482808:0:37:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1762166814.482813:0:37:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff945cf3704800 using connection 192.168.204.138@tcp/0@lo 00000400:00000100:2.0:1762166814.482820:0:3633:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1847765446843520 offset 0 length 224: 4 00000100:00100000:1.0:1762166814.482832:0:37:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc494ce00 x1847765446843776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1762166814.482889:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166814.482896:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166814.482899:0:37:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166814.482903:0:37:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1762166814.482906:0:37:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1762166814.482911:0:37:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff945bccb4e000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1762166814.482946:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446844032:0@lo:400:kworker.0 00000100:00100000:1.0:1762166814.482948:0:37:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc494d180 x1847765446844160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1762166814.482981:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1762166814.482990:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1762166814.482991:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166814.482994:0:37:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166814.482999:0:37:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1762166814.483008:0:37:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1762166814.483012:0:37:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945bc4b74800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1762166814.483021:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166814.483031:0:37:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf7838e00 x1847765446844416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166814.483033:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446843904:0@lo:400:kworker.0 00000100:00100000:3.0:1762166814.483068:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446843648:0@lo:38:kworker.0 00000100:00100000:2.0:1762166814.483089:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166814.483091:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1847765446844544:0@lo:400:kworker.0 00000100:00100000:0.0:1762166814.483125:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446844032 00000100:00100000:0.0:1762166814.483141:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446844032 00000100:00100000:2.0:1762166814.483143:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446844288:0@lo:400:kworker.0 00000100:00100000:1.0:1762166814.483153:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166814.483176:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166814.483193:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166814.483237:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446844544 00000100:00100000:3.0:1762166814.483244:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446843776:0@lo:38:kworker.0 00000100:00100000:1.0:1762166814.483247:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446844544 00000100:00100000:0.0:1762166814.483266:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446843904 00000100:00100000:0.0:1762166814.483273:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446843904 00000100:00100000:2.0:1762166814.483293:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446843648 00000100:00100000:3.0:1762166814.483300:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166814.483301:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446843648 00000100:00100000:0.0:1762166814.483327:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1762166814.483334:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446844160:0@lo:38:kworker.0 00000100:00100000:1.0:1762166814.483345:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446844288 00000100:00100000:0.0:1762166814.483348:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446844032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166814.483353:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446844288 00000100:00100000:2.0:1762166814.483363:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1762166814.483371:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166814.483381:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1847765446843648:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1762166814.483402:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446843776 00000100:00100000:1.0:1762166814.483408:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446843776 00010000:00020000:2.0:1762166814.483410:0:6499:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1762166814.483423:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446844416:0@lo:38:kworker.0 00000100:00100000:1.0:1762166814.483430:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446844160 00000100:00100000:1.0:1762166814.483438:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446844160 00000100:00100000:1.0:1762166814.483463:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1762166814.483472:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446844032:12345-0@lo:400:kworker.0 Request processed in 126us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166814.483536:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1847765446844544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166814.483555:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166814.483571:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1762166814.483573:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3632:x1847765446843648:12345-0@lo:38:kworker.0 Request processed in 187us (386us total) trans 0 rc -19/-19 00000100:00100000:2.0:1762166814.483588:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1762166814.483619:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1762166814.483623:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1847765446844544:12345-0@lo:400:kworker.0 Request processed in 142us (468us total) trans 0 rc 0/0 00000100:00080000:3.0:1762166814.483635:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1762166814.483640:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446843904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166814.483645:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00080000:3.0:1762166814.483654:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1762166814.483664:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446843648:0@lo:38:kworker.0 00000100:00100000:2.0:1762166814.483674:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446844416 00000100:00100000:1.0:1762166814.483689:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1762166814.483690:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446844416 00000100:00100000:1.0:1762166814.483711:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446844288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166814.483740:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:0.0:1762166814.483740:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446843904:12345-0@lo:400:kworker.0 Request processed in 97us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166814.483765:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1762166814.483766:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:2.0:1762166814.483767:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446843776:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1762166814.483789:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446844160:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1762166814.483790:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446844288:12345-0@lo:400:kworker.0 Request processed in 76us (588us total) trans 0 rc 0/0 00010000:00020000:2.0:1762166814.483791:0:12357:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1762166814.483803:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1762166814.483817:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166814.483823:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00010000:00020000:3.0:1762166814.483832:0:6494:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1762166814.483849:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:2.0:1762166814.483859:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446843776:12345-0@lo:38:kworker.0 Request processed in 100us (556us total) trans 0 rc -19/-19 00000100:00100000:0.0:1762166814.483861:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1847765446844416:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1762166814.483882:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00010000:00020000:0.0:1762166814.483887:0:30829:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1762166814.483893:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446844160:12345-0@lo:38:kworker.0 Request processed in 110us (524us total) trans 0 rc -19/-19 00000100:00100000:3.0:1762166814.483906:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:1.0:1762166814.483911:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1847765446844544:0@lo:400:kworker.0 00000100:00100000:0.0:1762166814.483971:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1847765446844416:12345-0@lo:38:kworker.0 Request processed in 105us (415us total) trans 0 rc -19/-19 00000100:00100000:2.0:1762166814.483988:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446844288:0@lo:400:kworker.0 00000100:00080000:3.0:1762166814.483994:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1762166814.483995:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00080000:3.0:1762166814.484007:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1762166814.484019:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446843776:0@lo:38:kworker.0 00000100:00100000:1.0:1762166814.484039:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446843904:0@lo:400:kworker.0 00000100:00080000:3.0:1762166814.484047:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1762166814.484059:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1762166814.484067:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446844160:0@lo:38:kworker.0 00000100:00080000:3.0:1762166814.484092:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1762166814.484097:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446844032:0@lo:400:kworker.0 00000100:00080000:3.0:1762166814.484098:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1762166814.484112:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446844416:0@lo:38:kworker.0 00010000:00010000:3.0:1762166814.546756:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1762166814.989339:0:3627:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.204.38@tcp portal 26 match 1847765440141440 offset 0 length 224: 4 00000100:00100000:3.0:1762166814.989401:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166814.989450:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166814.989571:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440141696 00000100:00100000:3.0:1762166814.989582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166814.989587:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440141696 00000100:00100000:1.0:1762166814.989597:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440141568 00000100:00100000:1.0:1762166814.989610:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440141568 00000100:00100000:3.0:1762166814.989643:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166814.989708:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 435 00000100:00100000:3.0:1762166814.989719:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440141824 00000100:00100000:3.0:1762166814.989727:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440141824 00000100:00100000:0.0:1762166814.989728:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2888 00000100:00100000:1.0:1762166814.989740:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440141696:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166814.989743:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2415:x1847765440141568:12345-192.168.204.38@tcp:38:kworker.0 00010000:00020000:0.0:1762166814.989790:0:6495:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1762166814.989802:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440141952 00000100:00100000:3.0:1762166814.989808:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440141952 00000100:00100000:3.0:1762166814.989876:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 275 00000100:00100000:3.0:1762166814.989891:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440141824:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166814.989897:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440141696:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 165us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166814.989917:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2415:x1847765440141568:12345-192.168.204.38@tcp:38:kworker.0 Request processed in 152us (444us total) trans 0 rc -19/-19 00000100:00100000:1.0:1762166814.989929:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 435 00000100:00100000:0.0:1762166814.989945:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2888 00000100:00100000:3.0:1762166814.989970:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440141824:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 78us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166814.989983:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 275 00000100:00080000:0.0:1762166814.990011:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166814.990016:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 276 00000100:00080000:0.0:1762166814.990021:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1762166814.990028:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1762166814.990030:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440141952:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166814.990078:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440141952:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166814.990087:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 276 00010000:00010000:1.0:1762166815.571581:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166816.018710:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166816.018740:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446844672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166816.018833:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.018921:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446844672 00000100:00100000:3.0:1762166816.018933:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446844672 00000100:00080000:1.0:1762166816.018980:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166816.019026:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1762166816.019041:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446844672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1762166816.019079:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3922440192 avail 3690917888 00000100:00100000:3.0:1762166816.019138:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446844672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166816.019147:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1762166816.019190:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446844672:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1762166816.594692:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:01200004:0.0:1762166816.826149:0:32213:0:(super25.c:139:lustre_fill_super()) VFS Op: sb ffff945cc7d3c800 00000020:01000004:0.0:1762166816.826204:0:32213:0:(obd_mount.c:901:lmd_print()) mount data: 00000020:01000004:0.0:1762166816.826206:0:32213:0:(obd_mount.c:904:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1762166816.826208:0:32213:0:(obd_mount.c:907:lmd_print()) options: user_xattr,errors=remount-ro 00000020:01000004:0.0:1762166816.826218:0:32213:0:(tgt_mount.c:2368:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1762166816.826232:0:32213:0:(obd_mount.c:184:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1762166816.826238:0:32213:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1762166816.826252:0:32213:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff945bc3470000) 00000020:00000080:0.0:1762166816.826267:0:32213:0:(obd_config.c:657:class_attach()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00000020:00000080:0.0:1762166816.826273:0:32213:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00100000:10000000:0.0:1762166816.844972:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.845862:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1762166816.846397:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.846536:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.846661:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.846793:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.846929:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.847069:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.847216:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.847351:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.847499:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.847634:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.847767:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.847915:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.848078:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.848217:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.848355:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.848495:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.848636:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.848768:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.848926:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.849078:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.849214:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.849349:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.849498:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.849618:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.849720:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.849821:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.849934:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.850064:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.850198:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.850316:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.850433:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1762166816.850538:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1762166816.852003:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1762166816.852244:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1762166816.852398:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.852541:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.852668:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1762166816.852791:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1762166816.852940:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.853106:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.853240:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1762166816.853395:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1762166816.853554:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.853709:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.854116:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.854653:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.854938:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.855248:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.855618:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.855777:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1762166816.856318:0:32213:0:(osd_scrub.c:1796:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1762166816.856958:0:32213:0:(osd_lproc.c:857:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1762166816.857112:0:32213:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1762166816.857120:0:32213:0:(osd_handler.c:8949:osd_obd_connect()) connect #0 00000020:00000080:0.0:1762166816.857128:0:32213:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f180c4effb0cc01 00000020:01000004:0.0:1762166816.857133:0:32213:0:(tgt_mount.c:2453:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1762166816.857142:0:32213:0:(tgt_mount.c:220:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1762166816.857150:0:32213:0:(tgt_mount.c:102:server_register_mount()) register mount ffff945cc7d3c800 from MGS 00000020:01000004:0.0:1762166816.857153:0:32213:0:(obd_mount.c:184:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1762166816.857156:0:32213:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1762166816.857164:0:32213:0:(genops.c:412:class_newdev()) Allocate new device MGS (ffff945bc3476360) 00000020:00000080:0.0:1762166816.857171:0:32213:0:(obd_config.c:657:class_attach()) OBD: dev 1 attached type mgs with refcount 2 00000020:00000080:0.0:1762166816.857174:0:32213:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1762166816.857218:0:32213:0:(tgt_mount.c:154:server_get_mount()) get mount ffff945cc7d3c800 from MGS, refs=2 00080000:01000000:0.0:1762166816.857221:0:32213:0:(osd_handler.c:8949:osd_obd_connect()) connect #1 00000020:00000080:0.0:1762166816.857224:0:32213:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f180c4effb0cc0f 00010000:00010000:0.0:1762166816.857293:0:32213:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1762166816.859719:0:32213:0:(llog_obd.c:195:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1762166816.860248:0:32218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1762166816.860269:0:32213:0:(mgs_nids.c:657:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1762166816.860299:0:32213:0:(mgs_llog.c:601:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1762166816.860925:0:32213:0:(mgs_llog.c:601:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1762166816.861325:0:32213:0:(service.c:153:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1762166816.861553:0:32213:0:(service.c:3434:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1762166816.861560:0:32213:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1762166816.862037:0:32213:0:(service.c:3434:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1762166816.862044:0:32213:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1762166816.862218:0:32213:0:(service.c:3434:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1762166816.862225:0:32213:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1762166816.862640:0:32213:0:(obd_config.c:761:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1762166816.862660:0:32213:0:(obd_mount.c:381:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1762166816.862662:0:32213:0:(obd_mount.c:392:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1762166816.862665:0:32213:0:(mgc_request.c:1068:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:0.0:1762166816.862671:0:32213:0:(import.c:65:import_set_state_nolock()) ffff945d011d0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1762166816.862686:0:32213:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.204.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1762166816.867012:0:32213:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.138@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1762166816.867016:0:32213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1762166816.867026:0:32213:0:(client.c:3549:ptlrpc_abort_inflight()) @@@ inflight req@ffff945bc58cd180 x1847765446840704/t0(0) o400->MGC192.168.204.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1762166820 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166816.867050:0:32213:0:(client.c:3549:ptlrpc_abort_inflight()) @@@ inflight req@ffff945bc5bbb100 x1847765446842112/t0(0) o400->MGC192.168.204.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1762166825 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166816.867075:0:32213:0:(client.c:3549:ptlrpc_abort_inflight()) @@@ inflight req@ffff945bc494d880 x1847765446843520/t0(0) o400->MGC192.168.204.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1762166830 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1762166816.867100:0:32213:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808001 00000100:00100000:1.0:1762166816.867104:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446840704:0@lo:400:kworker.0 00000100:00080000:0.0:1762166816.867105:0:32213:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1762166816.867109:0:32213:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1762166816.867114:0:32213:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1762166816.867126:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446842112:0@lo:400:kworker.0 00000100:00100000:3.0:1762166816.867154:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446843520:0@lo:400:kworker.0 10000000:01000000:0.0:1762166816.867239:0:32213:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1762166816.867266:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a200/0x2f180c4effafcc73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effafcc7a expref: -99 pid: 7407 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867276:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a200/0x2f180c4effafcc73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effafcc7a expref: -99 pid: 7407 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867285:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1762166816.867302:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867311:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a200/0x2f180c4effafcc73 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effafcc7a expref: -99 pid: 7407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867332:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a000/0x2f180c4effafd0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effafd0b7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867338:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a000/0x2f180c4effafd0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effafd0b7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867343:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867354:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867359:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a000/0x2f180c4effafd0b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effafd0b7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867369:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a800/0x2f180c4effafd0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effafd0c5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867375:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a800/0x2f180c4effafd0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effafd0c5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867381:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867391:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867396:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cc3d4a800/0x2f180c4effafd0be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effafd0c5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867417:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cc29cbc00/0x2f180c4effafd0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effafd0ef expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867423:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cc29cbc00/0x2f180c4effafd0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effafd0ef expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867428:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867439:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867442:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cc29cbc00/0x2f180c4effafd0e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effafd0ef expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867452:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cf3cb4e00/0x2f180c4effb07297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effb0729e expref: -99 pid: 24622 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867459:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cf3cb4e00/0x2f180c4effb07297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effb0729e expref: -99 pid: 24622 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867465:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867474:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867514:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cf3cb4e00/0x2f180c4effb07297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effb0729e expref: -99 pid: 24622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867527:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945bc60b0e00/0x2f180c4effb072d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effb072dd expref: -99 pid: 24622 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867534:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945bc60b0e00/0x2f180c4effb072d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effb072dd expref: -99 pid: 24622 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867540:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867554:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867560:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945bc60b0e00/0x2f180c4effb072d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effb072dd expref: -99 pid: 24622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867579:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945bccb88800/0x2f180c4effb07370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effb07377 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867586:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945bccb88800/0x2f180c4effb07370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effb07377 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867593:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867606:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867612:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945bccb88800/0x2f180c4effb07370 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effb07377 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867626:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb073af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effb073b6 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867633:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb073af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effb073b6 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867638:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867648:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867653:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb073af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effb073b6 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867668:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945bcaa2be00/0x2f180c4effb073ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effb073f5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867675:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945bcaa2be00/0x2f180c4effb073ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effb073f5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867680:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867690:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867696:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945bcaa2be00/0x2f180c4effb073ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effb073f5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867719:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cc3d4be00/0x2f180c4effafcc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effafcc88 expref: -99 pid: 7407 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867726:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cc3d4be00/0x2f180c4effafcc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effafcc88 expref: -99 pid: 7407 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867731:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1762166816.867743:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867749:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cc3d4be00/0x2f180c4effafcc81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effafcc88 expref: -99 pid: 7407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867763:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cf786a400/0x2f180c4effafd174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effafd17b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867770:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cf786a400/0x2f180c4effafd174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effafd17b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867775:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1762166816.867786:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867792:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cf786a400/0x2f180c4effafd174 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effafd17b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867802:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945cf3cb5200/0x2f180c4effb072c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effb072cf expref: -99 pid: 24622 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867808:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945cf3cb5200/0x2f180c4effb072c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effb072cf expref: -99 pid: 24622 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867813:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1762166816.867823:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867828:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945cf3cb5200/0x2f180c4effb072c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effb072cf expref: -99 pid: 24622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.867844:0:32213:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945bccb89800/0x2f180c4effb073a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x2f180c4effb073a8 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1762166816.867851:0:32213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945bccb89800/0x2f180c4effb073a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x2f180c4effb073a8 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.867856:0:32213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1762166816.867867:0:32213:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1762166816.867883:0:32213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945bccb89800/0x2f180c4effb073a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x2f180c4effb073a8 expref: -99 pid: 25939 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1762166816.867901:0:32213:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff945d011d0800 already not connected (conn 1, was 0): DISCONN 00000100:00080000:0.0:1762166816.867908:0:32213:0:(import.c:65:import_set_state_nolock()) ffff945d011d0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1762166816.867913:0:32213:0:(import.c:509:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 100 00000100:00080000:0.0:1762166816.867922:0:32213:0:(import.c:623:import_select_connection()) MGC192.168.204.138@tcp: import ffff945d011d0800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1762166816.867955:0:32213:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bcbe31880 x1847765446844800/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1762166816.867990:0:32213:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1762166816.868226:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3632:1847765446844800:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1762166816.868299:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.868382:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446844800 00000100:00100000:1.0:1762166816.868393:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446844800 00000100:00100000:1.0:1762166816.868444:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1762166816.868453:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3632:x1847765446844800:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1762166816.868509:0:32222:0:(ldlm_lib.c:1428:target_handle_connect()) MGS: connection from d5309af7-bf8a-40d1-8f22-842c4953c1ea@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:1.0:1762166816.868539:0:32222:0:(genops.c:1402:class_connect()) connect: client d5309af7-bf8a-40d1-8f22-842c4953c1ea, cookie 0x2f180c4effb0cc16 00000020:01000000:1.0:1762166816.868547:0:32222:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf1db1d00 00000100:00080000:1.0:1762166816.868676:0:32222:0:(import.c:65:import_set_state_nolock()) ffff945bc9576000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166816.868757:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+4:3632:x1847765446844800:12345-0@lo:250:mount.lustre.0 Request processed in 303us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.868767:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1762166816.868773:0:3632:0:(client.c:3071:ptlrpc_free_committed()) MGC192.168.204.138@tcp: committing for last_committed 0 gen 2 00000100:00080000:3.0:1762166816.868784:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) MGC192.168.204.138@tcp: connect to target with instance 0 00000100:00080000:3.0:1762166816.868809:0:3632:0:(import.c:951:ptlrpc_connect_set_flags()) MGC192.168.204.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1762166816.868813:0:3632:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1762166816.868818:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945d011d0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1762166816.868820:0:3632:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1762166816.868830:0:3632:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1762166816.868841:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3632:1847765446844800:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1762166816.868869:0:32213:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1762166816.868963:0:32213:0:(tgt_mount.c:1653:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1762166816.869010:0:32213:0:(tgt_mount.c:281:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1762166816.869016:0:32213:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1762166816.869150:0:32213:0:(llog_obd.c:195:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1762166816.869194:0:32213:0:(tgt_mount.c:1370:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1762166816.869197:0:32213:0:(tgt_mount.c:1147:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1762166816.869199:0:32213:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1762166816.869201:0:32213:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:0.0:1762166816.869202:0:32213:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:0.0:1762166816.869203:0:32213:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:0.0:1762166816.869208:0:32213:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:0.0:1762166816.869210:0:32213:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1762166816.869211:0:32213:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1762166816.869213:0:32213:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1762166816.869215:0:32213:0:(tgt_mount.c:1188:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1762166816.869217:0:32213:0:(mgc_request_server.c:415:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1762166816.869220:0:32213:0:(tgt_mount.c:1147:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1762166816.869222:0:32213:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1762166816.869223:0:32213:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:0.0:1762166816.869224:0:32213:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:0.0:1762166816.869224:0:32213:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:0.0:1762166816.869225:0:32213:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:0.0:1762166816.869226:0:32213:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1762166816.869227:0:32213:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1762166816.869228:0:32213:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1762166816.869228:0:32213:0:(tgt_mount.c:1188:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1762166816.869243:0:32213:0:(mgc_request_server.c:276:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1762166816.869255:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446844928:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1762166816.869287:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.869323:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.869337:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446844928 00000100:00100000:1.0:1762166816.869343:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446844928 00000100:00100000:1.0:1762166816.869374:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1762166816.869380:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+4:32213:x1847765446844928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1762166816.869424:0:32222:0:(mgs_llog.c:601:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1762166816.869427:0:32222:0:(mgs_handler.c:464:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1762166816.869430:0:32222:0:(mgs_handler.c:491:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1762166816.869736:0:32223:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1762166816.870133:0:32222:0:(mgs_nids.c:657:mgs_nidtbl_init_fs()) IR: current version is 13 20000000:01000000:2.0:1762166816.871104:0:32224:0:(mgs_llog.c:280:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1762166816.871108:0:32224:0:(mgs_llog.c:280:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1762166816.871111:0:32224:0:(mgs_llog.c:264:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1762166816.871113:0:32224:0:(mgs_llog.c:264:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1762166816.871229:0:32224:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1762166816.871321:0:32222:0:(mgs_llog.c:601:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1762166816.871327:0:32222:0:(mgs_handler.c:599:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1762166816.872234:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+4:32213:x1847765446844928:12345-0@lo:253:mount.lustre.0 Request processed in 2851us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.872243:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1762166816.872252:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446844928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1762166816.872265:0:32213:0:(mgc_request_server.c:297:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1762166816.872269:0:32213:0:(tgt_mount.c:1147:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1762166816.872271:0:32213:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1762166816.872272:0:32213:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:0.0:1762166816.872274:0:32213:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:0.0:1762166816.872276:0:32213:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:0.0:1762166816.872278:0:32213:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:0.0:1762166816.872279:0:32213:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1762166816.872281:0:32213:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1762166816.872282:0:32213:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1762166816.872283:0:32213:0:(tgt_mount.c:1188:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1762166816.872301:0:32213:0:(tgt_mount.c:102:server_register_mount()) register mount ffff945cc7d3c800 from lustre-MDT0000 10000000:01000000:0.0:1762166816.872322:0:32213:0:(mgc_request.c:1952:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1762166816.872326:0:32213:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1762166816.872333:0:32213:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff945cc7d3c800 10000000:01000000:0.0:1762166816.872337:0:32213:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1762166816.872346:0:32213:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff945cc7d3c800 10000000:01000000:0.0:1762166816.872350:0:32213:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1762166816.872353:0:32213:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-barrier-ffff945cc7d3c800 from 1 10000000:01000000:0.0:1762166816.872356:0:32213:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1762166816.872383:0:32213:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c0e00/0x2f180c4effb0cc1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.872392:0:32213:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bc95c0e00/0x2f180c4effb0cc1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.872401:0:32213:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bc95c0e00/0x2f180c4effb0cc1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166816.872414:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446845056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1762166816.872445:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.872473:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.872502:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446845056 00000100:00100000:1.0:1762166816.872509:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446845056 00000100:00100000:1.0:1762166816.872546:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1762166816.872555:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+4:32213:x1847765446845056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1762166816.872567:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166816.872582:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e2400/0x2f180c4effb0cc24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cc1d expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.872621:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e2400/0x2f180c4effb0cc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cc1d expref: 5 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.872631:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e2400/0x2f180c4effb0cc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cc1d expref: 5 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.872640:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2400, rc 0) 00000100:00100000:1.0:1762166816.872672:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+5:32213:x1847765446845056:12345-0@lo:101:mount.lustre.0 Request processed in 119us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.872679:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1762166816.872696:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446845056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1762166816.872710:0:32213:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bc95c0e00/0x2f180c4effb0cc1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cc24 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.872720:0:32213:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bc95c0e00/0x2f180c4effb0cc1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cc24 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.872732:0:32213:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1762166816.872747:0:32213:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c0e00/0x2f180c4effb0cc1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cc24 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.872755:0:32213:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bc95c0e00/0x2f180c4effb0cc1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cc24 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.872761:0:32213:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1762166816.872771:0:32213:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1762166816.872776:0:32213:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff945cc7d3c800 10000000:01000000:0.0:1762166816.872779:0:32213:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1762166816.872782:0:32213:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1762166816.872784:0:32213:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1762166816.872797:0:32213:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c1000/0x2f180c4effb0cc2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.872804:0:32213:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bc95c1000/0x2f180c4effb0cc2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.872811:0:32213:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bc95c1000/0x2f180c4effb0cc2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166816.872821:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446845184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1762166816.872846:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.872869:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.872904:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446845184 00000100:00100000:1.0:1762166816.872909:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446845184 00000100:00100000:1.0:1762166816.872949:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1762166816.872958:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+5:32213:x1847765446845184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1762166816.872966:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166816.872976:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e2e00/0x2f180c4effb0cc32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cc2b expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.872996:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e2e00/0x2f180c4effb0cc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cc2b expref: 6 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.873004:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e2e00/0x2f180c4effb0cc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cc2b expref: 6 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.873010:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2e00, rc 0) 00000100:00100000:1.0:1762166816.873041:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+6:32213:x1847765446845184:12345-0@lo:101:mount.lustre.0 Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.873048:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1762166816.873054:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446845184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1762166816.873068:0:32213:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bc95c1000/0x2f180c4effb0cc2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cc32 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.873076:0:32213:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bc95c1000/0x2f180c4effb0cc2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cc32 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166816.873119:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446845312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1762166816.873141:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.873159:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.873180:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446845312 00000100:00100000:1.0:1762166816.873191:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446845312 00000100:00100000:1.0:1762166816.873220:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1762166816.873228:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+6:32213:x1847765446845312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1762166816.873319:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+7:32213:x1847765446845312:12345-0@lo:501:mount.lustre.0 Request processed in 92us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.873328:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1762166816.873331:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446845312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1762166816.873365:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446845440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1762166816.873403:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.873426:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.873446:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446845440 00000100:00100000:1.0:1762166816.873451:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446845440 00000100:00100000:1.0:1762166816.873504:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1762166816.873514:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+7:32213:x1847765446845440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1762166816.873896:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+7:32213:x1847765446845440:12345-0@lo:503:mount.lustre.0 Request processed in 383us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.873904:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1762166816.873913:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446845440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1762166816.874149:0:32225:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32225:1847765446845568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1762166816.874186:0:32225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.874213:0:32225:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.874226:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446845568 00000100:00100000:1.0:1762166816.874231:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446845568 00000100:00100000:1.0:1762166816.874254:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1762166816.874260:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+7:32225:x1847765446845568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166816.874571:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+7:32225:x1847765446845568:12345-0@lo:502:llog_process_th.0 Request processed in 310us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.874578:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1762166816.874593:0:32225:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32225:1847765446845568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1762166816.874622:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1762166816.874631:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166816.874634:0:32225:0:(obd_config.c:1477:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1762166816.874639:0:32225:0:(obd_config.c:1865:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1762166816.874642:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1762166816.874655:0:32225:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff945cf7808000) 00000020:00000080:2.0:1762166816.874672:0:32225:0:(obd_config.c:657:class_attach()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1762166816.874676:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1762166816.874739:0:32225:0:(osd_handler.c:8949:osd_obd_connect()) connect #2 00000020:00000080:2.0:1762166816.874747:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f180c4effb0cc40 00000020:00000080:2.0:1762166816.874955:0:32225:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1762166816.874961:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1762166816.874964:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166816.874966:0:32225:0:(obd_config.c:1477:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1762166816.874968:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1762166816.874971:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166816.874972:0:32225:0:(obd_config.c:1477:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1762166816.874976:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1762166816.874991:0:32225:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0000 (ffff945cf3b04a88) 00000020:00000080:2.0:1762166816.875004:0:32225:0:(obd_config.c:657:class_attach()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1762166816.875008:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1762166816.875010:0:32225:0:(obd_config.c:1430:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1762166816.875013:0:32225:0:(obd_config.c:1074:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1762166816.875018:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1762166816.875063:0:32225:0:(tgt_mount.c:154:server_get_mount()) get mount ffff945cc7d3c800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1762166816.875076:0:32225:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDD0000 (ffff945cf3b06360) 00000020:00000080:2.0:1762166816.875084:0:32225:0:(obd_config.c:657:class_attach()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1762166816.875143:0:32225:0:(lod_dev.c:2266:lod_obd_connect()) connect #0 00000020:00000080:2.0:1762166816.875147:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f180c4effb0cc55 00000020:00000080:2.0:1762166816.875237:0:32225:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1762166816.875242:0:32225:0:(mdd_device.c:1570:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1762166816.875246:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2f180c4effb0cc5c 00080000:01000000:2.0:1762166816.875250:0:32225:0:(osd_handler.c:8949:osd_obd_connect()) connect #3 00000020:00000080:2.0:1762166816.875258:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f180c4effb0cc63 00010000:00010000:2.0:1762166816.911727:0:32225:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1762166816.912137:0:32225:0:(tgt_lastrcvd.c:1718:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 0 srv lr: 4294968872 lx: 0 gen 1 00000001:00080000:2.0:1762166816.912183:0:32225:0:(tgt_lastrcvd.c:1718:tgt_clients_data_init()) RCVRNG CLIENT uuid: e1e11365-ba0b-405b-99c9-a704373217f2 idx: 2 lr: 0 srv lr: 4294968872 lx: 0 gen 5 00000001:00000004:2.0:1762166816.912205:0:32225:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294968872 00000001:00080000:2.0:1762166816.912432:0:32225:0:(tgt_lastrcvd.c:187:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1762166816.912523:0:32225:0:(tgt_lastrcvd.c:2242:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff945cc63999c0: xid 1847765440139264, transno 4294969035, client gen 5, slot idx 0 00000001:00080000:2.0:1762166816.912535:0:32225:0:(tgt_lastrcvd.c:2242:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff945cc6399cc0: xid 1847765446801792, transno 4294968889, client gen 1, slot idx 1 00000001:00080000:2.0:1762166816.912542:0:32225:0:(tgt_lastrcvd.c:2242:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff945cf1c8dd80: xid 1847765440138880, transno 4294969034, client gen 5, slot idx 2 00000001:00080000:2.0:1762166816.912547:0:32225:0:(tgt_lastrcvd.c:2242:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff945ccef30480: xid 1847765440137472, transno 4294969030, client gen 5, slot idx 3 00000020:00000080:2.0:1762166816.912975:0:32225:0:(genops.c:412:class_newdev()) Allocate new device lustre-QMT0000 (ffff945cf3b00000) 00000020:00000080:2.0:1762166816.912997:0:32225:0:(obd_config.c:657:class_attach()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1762166816.913076:0:32225:0:(osd_handler.c:8949:osd_obd_connect()) connect #4 00000020:00000080:2.0:1762166816.913084:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f180c4effb0cc7f 00000020:00000080:2.0:1762166816.913411:0:32225:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1762166816.914987:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2f180c4effb0cc86 00000020:00000080:3.0:1762166816.915234:0:32225:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1762166816.915246:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1762166816.915251:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.915254:0:32225:0:(obd_config.c:1477:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1762166816.915258:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1762166816.915260:0:32225:0:(obd_config.c:1797:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1762166816.915261:0:32225:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1762166816.915263:0:32225:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1762166816.915264:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1762166816.915266:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.915267:0:32225:0:(obd_config.c:1477:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1762166816.915269:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1762166816.915273:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.915274:0:32225:0:(obd_config.c:1477:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1762166816.915278:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1762166816.915313:0:32225:0:(mdt_lproc.c:315:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1762166816.915327:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1762166816.915330:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.915332:0:32225:0:(obd_config.c:1477:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1762166816.915334:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1762166816.915336:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.915337:0:32225:0:(obd_config.c:1477:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1762166816.915339:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1762166816.915342:0:32225:0:(obd_config.c:1401:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:00000080:3.0:1762166816.915365:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1762166816.915376:0:32225:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff945bc43a98d8) 00000020:00000080:3.0:1762166816.915394:0:32225:0:(obd_config.c:657:class_attach()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1762166816.915399:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1762166816.915453:0:32225:0:(osp_dev.c:1191:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1762166816.915458:0:32225:0:(osd_handler.c:8949:osd_obd_connect()) connect #5 00000020:00000080:3.0:1762166816.915464:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f180c4effb0cc94 00010000:00080000:3.0:1762166816.915513:0:32225:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945bc43b7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1762166816.916987:0:32225:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1762166816.917629:0:32225:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1762166816.917638:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1762166816.917669:0:32225:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1762166816.917682:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f180c4effb0cc9b 00000100:00080000:0.0:1762166816.917690:0:32225:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1762166816.917695:0:32225:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff945bc43b7800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1762166816.917726:0:32225:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bcbe30700 x1847765446845696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1762166816.917748:0:32225:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1762166816.917769:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446845696:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1762166816.917792:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166816.917799:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166816.917802:0:36:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:01000000:0.0:1762166816.917805:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1762166816.917809:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 433 00000020:00000080:0.0:1762166816.917810:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1762166816.917813:0:32225:0:(obd_config.c:1477:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000100:00080000:1.0:1762166816.917814:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000020:01000000:0.0:1762166816.917815:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1762166816.917819:0:32225:0:(obd_config.c:1797:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1762166816.917821:0:32225:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000100:00080000:1.0:1762166816.917822:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff945cf35b7000 using connection 192.168.204.138@tcp/0@lo 00000020:01000000:0.0:1762166816.917823:0:32225:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1762166816.917824:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1762166816.917826:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1762166816.917827:0:32225:0:(obd_config.c:1477:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1762166816.917832:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1762166816.917836:0:32225:0:(obd_mount.c:939:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1762166816.917839:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1762166816.917841:0:32225:0:(obd_config.c:1477:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1762166816.917845:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf005 00000100:00100000:3.0:1762166816.917846:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1762166816.917851:0:32225:0:(obd_config.c:1401:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000100:00100000:1.0:1762166816.917852:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf783a300 x1847765446845824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1762166816.917868:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166816.917885:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166816.917887:0:36:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:01000000:0.0:1762166816.917890:0:32225:0:(obd_config.c:1873:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00080000:1.0:1762166816.917892:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 433 00000020:00000080:0.0:1762166816.917894:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000100:00080000:1.0:1762166816.917896:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1762166816.917903:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446845696 00000100:00080000:1.0:1762166816.917903:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff945cf3704800 using connection 192.168.204.138@tcp/0@lo 00000020:00000080:0.0:1762166816.917909:0:32225:0:(genops.c:412:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff945bc3474a88) 00000100:00100000:2.0:1762166816.917913:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446845696 00000100:00100000:1.0:1762166816.917925:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf783a680 x1847765446845952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1762166816.917925:0:32225:0:(obd_config.c:657:class_attach()) OBD: dev 15 attached type osp with refcount 2 00000100:00100000:3.0:1762166816.917931:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446845824:0@lo:38:kworker.0 00000020:00000080:0.0:1762166816.917932:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1762166816.917952:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1762166816.917963:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1847765446845696:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1762166816.917970:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166816.917992:0:32225:0:(osp_dev.c:1191:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00010000:00080000:2.0:1762166816.917993:0:6500:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000100:00100000:3.0:1762166816.917997:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446845952:0@lo:38:kworker.0 00000100:00080000:1.0:1762166816.917999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00080000:01000000:0.0:1762166816.917999:0:32225:0:(osd_handler.c:8949:osd_obd_connect()) connect #6 00000100:00080000:1.0:1762166816.918007:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000020:00000080:0.0:1762166816.918008:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f180c4effb0ccb0 00000100:00080000:1.0:1762166816.918010:0:36:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166816.918016:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1762166816.918019:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1762166816.918024:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff945bccb4e000 using connection 192.168.204.138@tcp/0@lo 00000020:00000080:2.0:1762166816.918032:0:6500:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f180c4effb0cca9 00000100:00100000:3.0:1762166816.918040:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.918042:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945ceffd1180 x1847765446846336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:2.0:1762166816.918046:0:6500:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:0.0:1762166816.918048:0:32225:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945d00f70800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.138@tcp at head 00000100:00100000:3.0:1762166816.918066:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446846336:0@lo:38:kworker.0 00000100:00080000:1.0:1762166816.918073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166816.918078:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166816.918080:0:36:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166816.918085:0:36:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1762166816.918088:0:36:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1762166816.918092:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945bc4b74800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1762166816.918096:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.918116:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945ceffd3b80 x1847765446846592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:2.0:1762166816.918117:0:6500:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf1f8fc00 00000100:00100000:3.0:1762166816.918138:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446845952 00000100:00100000:3.0:1762166816.918143:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446845952 00000100:00080000:2.0:1762166816.918148:0:6500:0:(import.c:65:import_set_state_nolock()) ffff945bc5936800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166816.918176:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446846336 00000100:00100000:1.0:1762166816.918176:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446846080:0@lo:400:kworker.0 00000100:00100000:3.0:1762166816.918181:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446846336 00000100:00100000:2.0:1762166816.918201:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1847765446845696:12345-0@lo:38:llog_process_th.0 Request processed in 239us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166816.918206:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:3.0:1762166816.918216:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446845952:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1762166816.918223:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1762166816.918227:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.918243:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446845824 00000100:00100000:2.0:1762166816.918247:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446845824 00000100:00100000:1.0:1762166816.918262:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1762166816.918268:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00010000:00010000:0.0:1762166816.918269:0:32225:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1762166816.918272:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446846720:0@lo:400:kworker.0 00000100:00100000:3.0:1762166816.918273:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446845952:12345-0@lo:38:kworker.0 Request processed in 56us (231us total) trans 0 rc -11/-11 00000100:00100000:2.0:1762166816.918277:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1847765446845824:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1762166816.918290:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:1.0:1762166816.918318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.918322:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3632:x1847765446845824:12345-0@lo:38:kworker.0 Request processed in 46us (353us total) trans 0 rc -11/-11 00000100:00100000:2.0:1762166816.918328:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1762166816.918392:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446846208:0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.918423:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.918456:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166816.918463:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446846464:0@lo:400:kworker.0 00000100:00100000:2.0:1762166816.918495:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446846080 00000100:00100000:2.0:1762166816.918500:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446846080 00000100:00100000:0.0:1762166816.918514:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446846720 00000100:00100000:1.0:1762166816.918515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.918521:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446846720 00000100:00100000:2.0:1762166816.918553:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446846208 00000100:00100000:0.0:1762166816.918555:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1762166816.918558:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446846208 00000100:00100000:1.0:1762166816.918565:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446846464 00000100:00100000:1.0:1762166816.918570:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446846464 00000100:00100000:2.0:1762166816.918593:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1762166816.918599:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446846720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.918607:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1762166816.918608:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446846080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.918618:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446846464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166816.918648:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446846720:12345-0@lo:400:kworker.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166816.918655:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1762166816.918668:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446846080:12345-0@lo:400:kworker.0 Request processed in 64us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.918674:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446846464:12345-0@lo:400:kworker.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166816.918678:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:2.0:1762166816.918683:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1762166816.918689:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1762166816.918690:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446846336:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1762166816.918708:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1762166816.918721:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446846208:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1762166816.918723:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166816.918728:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446846336:12345-0@lo:38:kworker.0 Request processed in 38us (630us total) trans 0 rc -11/-11 00000100:00080000:1.0:1762166816.918730:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166816.918737:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:2.0:1762166816.918771:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446846208:12345-0@lo:400:kworker.0 Request processed in 54us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166816.918779:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1762166816.918784:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446846464:0@lo:400:kworker.0 00000100:00100000:0.0:1762166816.918790:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446846592:0@lo:38:kworker.0 00000100:00100000:1.0:1762166816.918802:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446846208:0@lo:400:kworker.0 00000100:00100000:0.0:1762166816.918825:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.918841:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446846720:0@lo:400:kworker.0 00000100:00100000:1.0:1762166816.918854:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446846080:0@lo:400:kworker.0 00000100:00080000:0.0:1762166816.918862:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1762166816.918867:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1762166816.918884:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446846336:0@lo:38:kworker.0 00000100:00080000:0.0:1762166816.918899:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1762166816.918903:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1762166816.918911:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446845952:0@lo:38:kworker.0 00000100:00080000:0.0:1762166816.918924:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1762166816.918928:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1762166816.918931:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446845824:0@lo:38:kworker.0 00000100:00100000:0.0:1762166816.918945:0:3632:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1762166816.918949:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1762166816.918960:0:3632:0:(import.c:951:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1762166816.918964:0:3632:0:(import.c:1204:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1762166816.918966:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc43b7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1762166816.918982:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446845696:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1762166816.918996:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446846592 00000100:00100000:1.0:1762166816.919001:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446846592 00000100:00100000:1.0:1762166816.919029:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:1.0:1762166816.919035:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446846592:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1762166816.919113:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1847765446846592:12345-0@lo:38:kworker.0 Request processed in 76us (289us total) trans 0 rc -11/-11 00000100:00100000:1.0:1762166816.919120:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000040:01000000:0.0:1762166816.919123:0:32225:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1762166816.919141:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762166816.919149:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446846848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166816.919176:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1762166816.919179:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1762166816.919186:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1762166816.919191:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446846592:0@lo:38:kworker.0 00000100:00100000:2.0:1762166816.919219:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446846848 00000100:00100000:2.0:1762166816.919225:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446846848 00000100:00100000:2.0:1762166816.919255:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1762166816.919263:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446846848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1762166816.919286:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446199296 avail 1299959808 00000040:01000000:1.0:1762166816.919296:0:32225:0:(llog_obd.c:195:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1762166816.919346:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446846848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166816.919353:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1762166816.919378:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446846848:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1762166816.919738:0:32225:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 0, last_idx 1 00000040:00080000:1.0:1762166816.920175:0:32225:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1762166816.920269:0:32225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1762166816.922564:0:32225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1762166816.922838:0:32231:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1762166816.922843:0:32231:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1762166816.923411:0:32225:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1762166816.923423:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1762166816.923457:0:32225:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1762166816.923500:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f180c4effb0ccb7 00000100:00080000:1.0:1762166816.923509:0:32225:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1762166816.923515:0:32225:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff945d00f70800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1762166816.923546:0:32225:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf1ddca80 x1847765446846976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1762166816.923567:0:32225:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1762166816.923589:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446846976:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1762166816.923637:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1762166816.923642:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1762166816.923644:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1762166816.923647:0:32225:0:(obd_config.c:1477:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1762166816.923653:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1762166816.923656:0:32225:0:(obd_config.c:1797:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1762166816.923663:0:32225:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1762166816.923666:0:32225:0:(obd_config.c:1823:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1762166816.923668:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1762166816.923671:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1762166816.923673:0:32225:0:(obd_config.c:1477:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1762166816.923677:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1762166816.923681:0:32225:0:(obd_mount.c:939:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1762166816.923685:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1762166816.923686:0:32225:0:(obd_config.c:1477:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1762166816.923690:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1762166816.923694:0:32225:0:(obd_config.c:1401:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000100:00100000:3.0:1762166816.923699:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446846976 00000100:00100000:3.0:1762166816.923705:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446846976 00000020:01000000:1.0:1762166816.923716:0:32225:0:(obd_config.c:1873:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1762166816.923721:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1762166816.923732:0:32225:0:(genops.c:412:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff945bc40b6360) 00000020:00000080:1.0:1762166816.923749:0:32225:0:(obd_config.c:657:class_attach()) OBD: dev 22 attached type osp with refcount 2 00000100:00100000:3.0:1762166816.923755:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000020:00000080:1.0:1762166816.923757:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1762166816.923764:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1847765446846976:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1762166816.923795:0:9165:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1762166816.923828:0:9165:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f180c4effb0ccc5 00000004:00080000:1.0:1762166816.923839:0:32225:0:(osp_dev.c:1191:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00002000:00100000:3.0:1762166816.923841:0:9165:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff945bcc02b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2103b32 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1762166816.923848:0:9165:0:(ofd_obd.c:142:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00080000:01000000:1.0:1762166816.923848:0:32225:0:(osd_handler.c:8949:osd_obd_connect()) connect #7 00002000:00100000:3.0:1762166816.923854:0:9165:0:(ofd_obd.c:230:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:1.0:1762166816.923861:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f180c4effb0cccc 00010000:00080000:1.0:1762166816.923914:0:32225:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945d011d2000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.138@tcp at head 00000020:01000000:3.0:1762166816.923932:0:9165:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945bc49ab600 00002000:00080000:3.0:1762166816.923946:0:9165:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1762166816.923969:0:9165:0:(import.c:65:import_set_state_nolock()) ffff945bc81f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166816.924025:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3632:x1847765446846976:12345-0@lo:8:llog_process_th.0 Request processed in 261us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166816.924034:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1762166816.924066:0:3632:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1762166816.924076:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00000100:00080000:0.0:1762166816.924084:0:3632:0:(import.c:951:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1762166816.924089:0:3632:0:(import.c:1204:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1762166816.924092:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945d00f70800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1762166816.924120:0:3632:0:(osp_dev.c:1635:osp_import_event()) got connected 00010000:00010000:1.0:1762166816.924127:0:32225:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:0.0:1762166816.924127:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446846976:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1762166816.924179:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446847104:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1762166816.924189:0:32231:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 132 count 2 00000100:00100000:0.0:1762166816.924203:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446847232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166816.924217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1762166816.924220:0:32231:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1762166816.924224:0:32231:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1762166816.924240:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166816.924244:0:32231:0:(osp_sync.c:973:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1762166816.924261:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446847104 00000100:00100000:2.0:1762166816.924267:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446847104 00000100:00100000:0.0:1762166816.924286:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446847232 00000004:00080000:3.0:1762166816.924288:0:32231:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436072809614ns, next at 0ns, rc = 0 00000100:00100000:0.0:1762166816.924292:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446847232 00080000:00080000:3.0:1762166816.924297:0:32231:0:(osd_handler.c:2861:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1762166816.924310:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166816.924323:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1762166816.924332:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1762166816.924336:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446847104:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166816.924347:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446847232:12345-0@lo:2:osp-syn-0-0.0 00000040:01000000:1.0:1762166816.924354:0:32225:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00002000:00000024:2.0:1762166816.924360:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51822272 pending 0 free 3921379328 avail 3689857024 00000040:01000000:1.0:1762166816.924370:0:32225:0:(llog_obd.c:195:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1762166816.924412:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446847104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166816.924421:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1762166816.924433:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446847104:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1762166816.925216:0:32225:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000004:00080000:3.0:1762166816.925433:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1762166816.925624:0:32225:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1762166816.925827:0:32225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1762166816.925991:0:32225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1762166816.926223:0:32233:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1762166816.926227:0:32233:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00080000:1.0:1762166816.926430:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836710 is committed 00000001:00100000:1.0:1762166816.926438:0:24624:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1762166816.926520:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1762166816.926529:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb mtime from disk: 1762166795 -> 1762166795 00002000:00010000:3.0:1762166816.926532:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166816.926534:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb ctime from disk: 1762166795 -> 1762166795 00002000:00010000:3.0:1762166816.926536:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x4d:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1762166816.926586:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446847232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2243us (2346us total) trans 21474836710 rc 0/0 00000100:00100000:3.0:1762166816.926595:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000004:00080000:0.0:1762166816.926604:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc494c000, transno 21474836710 00000100:00100000:0.0:1762166816.926624:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836710 gen 2 00000004:00080000:0.0:1762166816.926629:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc494c000/2, rc 0, transno 21474836710 00000100:00100000:0.0:1762166816.926651:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446847232:0@lo:2:osp-syn-0-0.0 00000040:00080000:1.0:1762166816.926696:0:32231:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 1, last_idx 2 00000040:00080000:1.0:1762166816.926715:0:32231:0:(llog_cat.c:1254:llog_cat_cleanup()) cancel plain log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1762166816.926739:0:32225:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1762166816.926750:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1762166816.926801:0:32225:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1762166816.926822:0:32225:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f180c4effb0ccd3 00000100:00080000:2.0:1762166816.926829:0:32225:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1762166816.926834:0:32225:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff945d011d2000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1762166816.926860:0:32225:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bc406d880 x1847765446847360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1762166816.926894:0:32225:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1762166816.926910:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446847360:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1762166816.926946:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1762166816.926952:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166816.926960:0:32225:0:(obd_config.c:1477:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000100:00100000:0.0:1762166816.926965:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1762166816.926966:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1762166816.926972:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166816.926974:0:32225:0:(obd_config.c:1477:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1762166816.926978:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1762166816.926981:0:32225:0:(obd_config.c:1451:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1762166816.926984:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1762166816.926987:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166816.926989:0:32225:0:(obd_config.c:1477:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000100:00100000:3.0:1762166816.926992:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446847360 00000020:01000000:2.0:1762166816.926994:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1762166816.926999:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446847360 00000020:00000080:2.0:1762166816.927000:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166816.927004:0:32225:0:(obd_config.c:1477:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1762166816.927009:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1762166816.927025:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1762166816.927031:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1847765446847360:12345-0@lo:8:llog_process_th.0 00000100:00100000:2.0:1762166816.927043:0:32225:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32225:1847765446847488:0@lo:502:llog_process_th.0 00010000:00080000:3.0:1762166816.927053:0:9165:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1762166816.927076:0:9165:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f180c4effb0ccda 00002000:00100000:3.0:1762166816.927087:0:9165:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff945cc5450000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2103b32 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1762166816.927091:0:9165:0:(ofd_obd.c:142:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1762166816.927096:0:9165:0:(ofd_obd.c:230:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1762166816.927097:0:32225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.927127:0:32225:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c49780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.927127:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446847488 00000100:00100000:1.0:1762166816.927131:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446847488 00000020:01000000:3.0:1762166816.927141:0:9165:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc9241100 00002000:00080000:3.0:1762166816.927150:0:9165:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1762166816.927163:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1762166816.927168:0:9165:0:(import.c:65:import_set_state_nolock()) ffff945cc5450800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166816.927172:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+7:32225:x1847765446847488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1762166816.927212:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3632:x1847765446847360:12345-0@lo:8:llog_process_th.0 Request processed in 178us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166816.927220:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1762166816.927229:0:3632:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1762166816.927234:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 4 00000100:00100000:1.0:1762166816.927250:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+7:32225:x1847765446847488:12345-0@lo:502:llog_process_th.0 Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.927258:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1762166816.927258:0:3632:0:(import.c:951:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1762166816.927265:0:3632:0:(import.c:1204:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1762166816.927267:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945d011d2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1762166816.927278:0:3632:0:(osp_dev.c:1635:osp_import_event()) got connected 00000100:00100000:2.0:1762166816.927283:0:32225:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32225:1847765446847488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1762166816.927285:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1847765446847360:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1762166816.927314:0:32225:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1762166816.927320:0:32225:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1762166816.927323:0:32225:0:(obd_config.c:1477:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1762166816.927327:0:32225:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:1.0:1762166816.927329:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446847616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166816.927344:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446847744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166816.927367:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.927378:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.927403:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446847616 00000100:00100000:3.0:1762166816.927408:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446847616 00000020:01000000:0.0:1762166816.927425:0:32213:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 00000100:00080000:1.0:1762166816.927435:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166816.927446:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 10000000:01000000:0.0:1762166816.927450:0:32213:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1762166816.927455:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446847616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1762166816.927467:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3922440192 avail 3690917888 00010000:00010000:0.0:1762166816.927468:0:32213:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c1000/0x2f180c4effb0cc2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cc32 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.927501:0:32213:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bc95c1000/0x2f180c4effb0cc2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cc32 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.927510:0:32213:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-mdtir-ffff945cc7d3c800 from 1 10000000:01000000:0.0:1762166816.927513:0:32213:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1762166816.927535:0:32213:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166816.927539:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446847616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (173us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166816.927544:0:32213:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166816.927546:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00010000:0.0:1762166816.927559:0:32213:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166816.927573:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446847872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1762166816.927581:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446847616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166816.927604:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446848000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166816.927615:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.927639:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446847872 00000100:00100000:2.0:1762166816.927644:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.927645:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.927646:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446847872 00000100:00100000:0.0:1762166816.927668:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446847744 00000100:00100000:0.0:1762166816.927673:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446847744 00000100:00100000:3.0:1762166816.927683:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446848000 00000100:00100000:1.0:1762166816.927683:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1762166816.927688:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446848000 00000100:00100000:1.0:1762166816.927694:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+7:32213:x1847765446847872:12345-0@lo:101:mount.lustre.0 00000100:00100000:0.0:1762166816.927703:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00010000:00010000:1.0:1762166816.927705:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166816.927710:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1762166816.927710:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446847744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166816.927715:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446848000:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166816.927720:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cce1 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.927746:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 8 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.927757:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 8 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.927766:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3400, rc 0) 00000100:00100000:0.0:1762166816.927779:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446847744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (399us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166816.927787:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1762166816.927788:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446848000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (148us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166816.927794:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1762166816.927803:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+8:32213:x1847765446847872:12345-0@lo:101:mount.lustre.0 Request processed in 111us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.927815:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:2.0:1762166816.927822:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dded80, transno 0 00000004:00080000:0.0:1762166816.927828:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe32d80, transno 0 00000004:00080000:2.0:1762166816.927829:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1dded80/1, rc -2, transno 0 00000004:00080000:0.0:1762166816.927833:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe32d80/1, rc -2, transno 0 00000100:00100000:2.0:1762166816.927845:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446848000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166816.927846:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446847744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166816.927894:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446847872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1762166816.927910:0:32213:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.927917:0:32213:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166816.927937:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446848128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166816.927962:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446848256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166816.927973:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.928005:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446848128 00000100:00100000:3.0:1762166816.928006:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.928011:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446848128 00000100:00100000:3.0:1762166816.928032:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762166816.928035:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1762166816.928040:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446848384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166816.928044:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446848128:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166816.928056:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446848256 00002000:00080000:1.0:1762166816.928057:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:69 count 1 00000100:00100000:3.0:1762166816.928065:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.928069:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446848256 00000100:00100000:2.0:1762166816.928104:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446848384 00000100:00100000:2.0:1762166816.928109:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446848384 00000100:00100000:3.0:1762166816.928116:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1762166816.928116:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446848128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 70us (141us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166816.928127:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446848256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166816.928128:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1762166816.928138:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00002000:00080000:3.0:1762166816.928143:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:70 count 1 00000100:00100000:2.0:1762166816.928150:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446848384:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762166816.928164:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dded80, transno 0 00000004:00080000:1.0:1762166816.928169:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1dded80/1, rc -2, transno 0 00000100:00100000:1.0:1762166816.928179:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446848128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166816.928199:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446848256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 75us (192us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166816.928206:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000004:00080000:3.0:1762166816.928238:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddce00, transno 0 00000004:00080000:3.0:1762166816.928241:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1ddce00/1, rc -2, transno 0 00000100:00100000:3.0:1762166816.928252:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446848256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166816.928438:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446848512:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1762166816.928467:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.928514:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446848512 00000100:00100000:0.0:1762166816.928516:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.928519:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446848512 00000100:00100000:1.0:1762166816.928551:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1762166816.928559:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+8:32213:x1847765446848512:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1762166816.928573:0:32221:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1762166816.928579:0:32221:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1762166816.928650:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+8:32213:x1847765446848512:12345-0@lo:256:mount.lustre.0 Request processed in 92us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166816.928657:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446848512:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1762166816.928660:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 10000000:01000000:0.0:1762166816.929090:0:32213:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1762166816.929101:0:32213:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.929106:0:32213:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1762166816.929110:0:32213:0:(mgc_request.c:1812:mgc_process_log()) Process log params-ffff945cc7d3c800 from 1 10000000:01000000:0.0:1762166816.929111:0:32213:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1762166816.929122:0:32213:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c0000/0x2f180c4effb0ccef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.929126:0:32213:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bc95c0000/0x2f180c4effb0ccef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.929131:0:32213:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bc95c0000/0x2f180c4effb0ccef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166816.929139:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446848640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1762166816.929162:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.929179:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.929199:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446848640 00000100:00100000:1.0:1762166816.929205:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446848640 00000100:00100000:1.0:1762166816.929238:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1762166816.929246:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+8:32213:x1847765446848640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1762166816.929254:0:32221:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166816.929269:0:32221:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e2600/0x2f180c4effb0ccf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0ccef expref: -99 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.929283:0:32221:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e2600/0x2f180c4effb0ccf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0ccef expref: 9 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.929290:0:32221:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e2600/0x2f180c4effb0ccf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0ccef expref: 9 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.929296:0:32221:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2600, rc 0) 00000100:00100000:1.0:1762166816.929337:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32213:x1847765446848640:12345-0@lo:101:mount.lustre.0 Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.929345:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1762166816.929353:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446848640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1762166816.929365:0:32213:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bc95c0000/0x2f180c4effb0ccef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0ccf6 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166816.929373:0:32213:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bc95c0000/0x2f180c4effb0ccef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0ccf6 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166816.929413:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446848768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1762166816.929441:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.929459:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.929474:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446848768 00000100:00100000:1.0:1762166816.929494:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446848768 00000100:00100000:1.0:1762166816.929523:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1762166816.929533:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32213:x1847765446848768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1762166816.929627:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32213:x1847765446848768:12345-0@lo:501:mount.lustre.0 Request processed in 96us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.929635:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1762166816.929645:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446848768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1762166816.929677:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446848896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1762166816.929712:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.929738:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.929747:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446848896 00000100:00100000:1.0:1762166816.929752:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446848896 00000100:00100000:1.0:1762166816.929781:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1762166816.929789:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32213:x1847765446848896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1762166816.929880:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32213:x1847765446848896:12345-0@lo:503:mount.lustre.0 Request processed in 84us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.929889:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1762166816.929894:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446848896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1762166816.930128:0:32235:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32235:1847765446849024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1762166816.930167:0:32235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.930187:0:32235:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.930201:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446849024 00000100:00100000:1.0:1762166816.930206:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446849024 00000100:00100000:1.0:1762166816.930236:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1762166816.930242:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32235:x1847765446849024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166816.930725:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32235:x1847765446849024:12345-0@lo:502:llog_process_th.0 Request processed in 481us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.930732:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1762166816.930735:0:32235:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32235:1847765446849024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1762166816.930783:0:32235:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1762166816.930791:0:32235:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.930793:0:32235:0:(obd_config.c:1477:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000001:00100000:0.0:1762166816.930800:0:25941:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1762166816.930801:0:32235:0:(obd_config.c:1903:class_config_llog_handler()) cmd ce032, instance name: general-ffff945cc7d3c800 00000020:00000080:3.0:1762166816.930806:0:32235:0:(obd_config.c:1389:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1762166816.930813:0:32235:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1762166816.930815:0:32235:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.930816:0:32235:0:(obd_config.c:1477:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1762166816.930819:0:32235:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1762166816.930822:0:32235:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.930823:0:32235:0:(obd_config.c:1477:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1762166816.930827:0:32235:0:(obd_config.c:1903:class_config_llog_handler()) cmd ce032, instance name: general-ffff945cc7d3c800 00000020:00000080:3.0:1762166816.930829:0:32235:0:(obd_config.c:1389:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1762166816.930926:0:32235:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32235:1847765446849152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1762166816.930991:0:32235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.930992:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446848384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2834us (2916us total) trans 0 rc -22/-22 00000004:00080000:1.0:1762166816.930995:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddd180, transno 0 00000004:00080000:1.0:1762166816.931007:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1ddd180/1, rc -22, transno 0 00000100:00100000:2.0:1762166816.931018:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1762166816.931028:0:32235:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79ae6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.931029:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446848384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166816.931067:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446849152 00000100:00100000:1.0:1762166816.931070:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446849152 00000100:00100000:1.0:1762166816.931098:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1762166816.931103:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32235:x1847765446849152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166816.931171:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32235:x1847765446849152:12345-0@lo:502:llog_process_th.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.931178:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1762166816.931211:0:32235:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32235:1847765446849152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1762166816.931235:0:32235:0:(obd_config.c:1788:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1762166816.931241:0:32235:0:(obd_config.c:1389:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1762166816.931243:0:32235:0:(obd_config.c:1477:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1762166816.931248:0:32235:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:1.0:1762166816.931259:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166816.931271:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446849280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166816.931302:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1762166816.931334:0:32213:0:(obd_config.c:2039:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 00000100:00100000:1.0:1762166816.931353:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446849280 00000100:00100000:1.0:1762166816.931361:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446849280 10000000:01000000:2.0:1762166816.931387:0:32213:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00000100:00100000:1.0:1762166816.931407:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00010000:00010000:2.0:1762166816.931414:0:32213:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c0000/0x2f180c4effb0ccef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0ccf6 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166816.931424:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446849280:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166816.931444:0:32213:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bc95c0000/0x2f180c4effb0ccef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0ccf6 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166816.931561:0:32213:0:(mgc_request.c:1952:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1762166816.931565:0:32213:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff945cc7d3c800 10000000:01000000:2.0:1762166816.931568:0:32213:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff945cc7d3c800 10000000:01000000:2.0:1762166816.931573:0:32213:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1762166816.931580:0:32213:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-client-ffff945cc7d3c800 from 1 10000000:01000000:2.0:1762166816.931582:0:32213:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1762166816.931611:0:32213:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc5ae4600/0x2f180c4effb0ccfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.931618:0:32213:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bc5ae4600/0x2f180c4effb0ccfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166816.931628:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446849280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (317us total) trans 0 rc -22/-22 00000004:00080000:3.0:1762166816.931632:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddd180, transno 0 00010000:00010000:2.0:1762166816.931634:0:32213:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bc5ae4600/0x2f180c4effb0ccfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166816.931650:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1ddd180/1, rc -22, transno 0 00000100:00100000:1.0:1762166816.931650:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1762166816.931677:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446849280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166816.931681:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446849408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1762166816.931742:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446849536:0@lo:2:osp-syn-1-0.0 00000040:00080000:1.0:1762166816.931750:0:32233:0:(llog.c:854:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 125 count 4 00000100:00100000:2.0:1762166816.931765:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.931801:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.931808:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446849408 00000100:00100000:1.0:1762166816.931814:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446849408 00000100:00100000:2.0:1762166816.931842:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c49cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.931866:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1762166816.931887:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446849536 00000100:00100000:1.0:1762166816.931890:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:32213:x1847765446849408:12345-0@lo:101:mount.lustre.0 00000100:00100000:3.0:1762166816.931893:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446849536 00010000:00010000:1.0:1762166816.931901:0:32221:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166816.931914:0:32221:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e2800/0x2f180c4effb0cd04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0ccfd expref: -99 pid: 32221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166816.931933:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00010000:00010000:1.0:1762166816.931934:0:32221:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e2800/0x2f180c4effb0cd04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0ccfd expref: 10 pid: 32221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166816.931951:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446849536:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166816.931951:0:32221:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e2800/0x2f180c4effb0cd04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0ccfd expref: 10 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.931965:0:32221:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e2800, rc 0) 00000100:00100000:1.0:1762166816.932018:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32213:x1847765446849408:12345-0@lo:101:mount.lustre.0 Request processed in 144us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.932025:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1762166816.932033:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446849408:0@lo:101:mount.lustre.0 00002000:00010000:3.0:1762166816.932046:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb size from disk: 1048576 -> 1048576 00010000:00010000:2.0:1762166816.932050:0:32213:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bc5ae4600/0x2f180c4effb0ccfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd04 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166816.932053:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb mtime from disk: 1762166795 -> 1762166795 00000040:00080000:1.0:1762166816.932063:0:32233:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00002000:00010000:3.0:1762166816.932072:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb atime from disk: 1762166795 -> 1762166795 00000040:00080000:1.0:1762166816.932074:0:32233:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00010000:00010000:2.0:1762166816.932077:0:32213:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bc5ae4600/0x2f180c4effb0ccfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd04 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166816.932081:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb ctime from disk: 1762166795 -> 1762166795 00002000:00010000:3.0:1762166816.932097:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x47:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00080000:1.0:1762166816.932101:0:32233:0:(osp_sync.c:973:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1762166816.932141:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446849536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (348us total) trans 17179869389 rc 0/0 00000100:00100000:3.0:1762166816.932149:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000004:00080000:1.0:1762166816.932153:0:32233:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 436080674693ns, next at 0ns, rc = 0 00080000:00080000:1.0:1762166816.932161:0:32233:0:(osd_handler.c:2861:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1762166816.932190:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1dded80/2, rc 0, transno 17179869389 00000100:00100000:2.0:1762166816.932198:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446849664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1762166816.932200:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446849536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166816.932266:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.932297:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c49cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.932299:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446849664 00000100:00100000:1.0:1762166816.932308:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446849664 00000100:00100000:1.0:1762166816.932344:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1762166816.932354:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32213:x1847765446849664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1762166816.932452:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32213:x1847765446849664:12345-0@lo:501:mount.lustre.0 Request processed in 99us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.932470:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1762166816.932526:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446849664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1762166816.932570:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446849792:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1762166816.932630:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.932663:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446849792 00000100:00100000:1.0:1762166816.932671:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446849792 00000100:00100000:2.0:1762166816.932672:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c49cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.932717:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1762166816.932731:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32213:x1847765446849792:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1762166816.932824:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32213:x1847765446849792:12345-0@lo:503:mount.lustre.0 Request processed in 90us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.932835:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1762166816.932850:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446849792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1762166816.933182:0:32237:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32237:1847765446849920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1762166816.933234:0:32237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.933258:0:32237:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.933272:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446849920 00000100:00100000:1.0:1762166816.933278:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446849920 00000100:00100000:1.0:1762166816.933307:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1762166816.933316:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32237:x1847765446849920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166816.933397:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32237:x1847765446849920:12345-0@lo:502:llog_process_th.0 Request processed in 82us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.933405:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1762166816.933426:0:32237:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32237:1847765446849920:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1762166816.933526:0:32237:0:(obd_mount.c:184:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1762166816.933531:0:32237:0:(obd_config.c:1389:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1762166816.933549:0:32237:0:(genops.c:412:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff945bc34731b0) 00000020:00000080:0.0:1762166816.933586:0:32237:0:(obd_config.c:657:class_attach()) OBD: dev 28 attached type lwp with refcount 2 00000004:00080000:1.0:1762166816.933590:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:00000080:0.0:1762166816.933591:0:32237:0:(obd_config.c:1389:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1762166816.933740:0:32237:0:(tgt_mount.c:154:server_get_mount()) get mount ffff945cc7d3c800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1762166816.933744:0:32237:0:(tgt_mount.c:188:server_put_mount()) put mount ffff945cc7d3c800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1762166816.933746:0:32237:0:(obd_mount.c:705:lustre_put_lsi()) put ffff945cc7d3c800 4 00010000:00080000:0.0:1762166816.933775:0:32237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945cf784f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1762166816.935739:0:32237:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1762166816.935854:0:32237:0:(obd_config.c:761:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1762166816.935914:0:32237:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1762166816.935926:0:32237:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2f180c4effb0cd12 00000100:00080000:0.0:1762166816.935934:0:32237:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1762166816.935946:0:32237:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff945cf784f000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1762166816.935979:0:32237:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945bcbe30380 x1847765446850048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1762166816.936006:0:32237:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1762166816.936045:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1847765446850048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1762166816.936095:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.936179:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446850048 00000100:00100000:1.0:1762166816.936185:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446850048 00000100:00100000:0.0:1762166816.936198:0:32237:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32237:1847765446850176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166816.936214:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:1.0:1762166816.936221:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446850048:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1762166816.936241:0:32237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.936261:0:32237:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.936274:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446850048:12345-0@lo:38:llog_process_th.0 Request processed in 52us (178us total) trans 0 rc -11/-11 00000100:00100000:1.0:1762166816.936281:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00100000:1.0:1762166816.936318:0:3632:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1762166816.936331:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf784f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1762166816.936336:0:3632:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1762166816.936340:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1847765446850048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1762166816.936362:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446850176 00000100:00100000:1.0:1762166816.936366:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446850176 00000100:00100000:1.0:1762166816.936389:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1762166816.936394:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32237:x1847765446850176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166816.936505:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32237:x1847765446850176:12345-0@lo:502:llog_process_th.0 Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.936512:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1762166816.936552:0:32237:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32237:1847765446850176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1762166816.936593:0:32237:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32237:1847765446850304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1762166816.936628:0:32237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.936659:0:32237:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccb393cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.936664:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446850304 00000100:00100000:1.0:1762166816.936670:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446850304 00000100:00100000:1.0:1762166816.936700:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1762166816.936710:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32237:x1847765446850304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1762166816.936776:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32237:x1847765446850304:12345-0@lo:502:llog_process_th.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.936784:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1762166816.936787:0:32237:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32237:1847765446850304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1762166816.936816:0:32237:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1762166816.936894:0:32213:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1762166816.936922:0:32213:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1762166816.936941:0:32213:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc5ae4600/0x2f180c4effb0ccfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd04 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.936953:0:32213:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bc5ae4600/0x2f180c4effb0ccfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd04 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000020:01000004:2.0:1762166816.937009:0:32213:0:(tgt_mount.c:1147:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1762166816.937011:0:32213:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1762166816.937017:0:32213:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:2.0:1762166816.937018:0:32213:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:2.0:1762166816.937019:0:32213:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:2.0:1762166816.937021:0:32213:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:2.0:1762166816.937023:0:32213:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1762166816.937024:0:32213:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1762166816.937025:0:32213:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1762166816.937027:0:32213:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1762166816.937031:0:32213:0:(mgc_request_server.c:415:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1762166816.937034:0:32213:0:(tgt_mount.c:1147:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1762166816.937035:0:32213:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1762166816.937036:0:32213:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:2.0:1762166816.937037:0:32213:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00000020:01000004:2.0:1762166816.937039:0:32213:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:2.0:1762166816.937040:0:32213:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:2.0:1762166816.937041:0:32213:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1762166816.937042:0:32213:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1762166816.937043:0:32213:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1762166816.937044:0:32213:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1762166816.937058:0:32213:0:(mgc_request_server.c:276:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1762166816.937069:0:32213:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446850432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1762166816.937103:0:32213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.937125:0:32213:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7f52f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.937139:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446850432 00000100:00100000:1.0:1762166816.937144:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446850432 00000100:00100000:1.0:1762166816.937177:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1762166816.937186:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32213:x1847765446850432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1762166816.937210:0:32221:0:(mgs_handler.c:438:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1762166816.937225:0:32221:0:(mgs_nids.c:460:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1762166816.938923:0:32221:0:(mgs_nids.c:806:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1762166816.938942:0:32221:0:(mgs_handler.c:599:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1762166816.938970:0:32223:0:(mgs_nids.c:703:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1762166816.938988:0:32223:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1762166816.939015:0:32223:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.939031:0:32223:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 10 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.939040:0:32223:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.939072:0:32223:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 10 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.939113:0:32223:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 10 pid: 32222 timeout: 536 lvb_type: 0 00000100:00100000:2.0:1762166816.939126:0:32223:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32223:1847765446850560:0@lo:104: 00000100:00100000:2.0:1762166816.939162:0:32223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166816.939206:0:32223:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c49780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.939318:0:8397:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446850560 00000100:00100000:1.0:1762166816.939333:0:8397:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446850560 00000100:00100000:2.0:1762166816.939363:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:32213:x1847765446850432:12345-0@lo:253:mount.lustre.0 Request processed in 2176us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166816.939377:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1762166816.939414:0:32213:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d5309af7-bf8a-40d1-8f22-842c4953c1ea:32213:1847765446850432:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1762166816.939416:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1762166816.939430:0:8397:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+3:32223:x1847765446850560:12345-0@lo:104: 10000000:01000000:3.0:1762166816.939434:0:32213:0:(mgc_request_server.c:297:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1762166816.939440:0:32213:0:(tgt_mount.c:1147:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1762166816.939442:0:32213:0:(tgt_mount.c:1148:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1762166816.939445:0:32213:0:(tgt_mount.c:1149:server_mti_print()) fs: lustre 00000020:01000004:3.0:1762166816.939448:0:32213:0:(tgt_mount.c:1150:server_mti_print()) uuid: 00010000:00010000:1.0:1762166816.939448:0:8397:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000020:01000004:3.0:1762166816.939455:0:32213:0:(tgt_mount.c:1151:server_mti_print()) ver: 0 00000020:01000004:3.0:1762166816.939460:0:32213:0:(tgt_mount.c:1152:server_mti_print()) flags: 00000020:01000004:3.0:1762166816.939465:0:32213:0:(tgt_mount.c:1154:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1762166816.939468:0:32213:0:(tgt_mount.c:1158:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1762166816.939469:0:32213:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1762166816.939470:0:32213:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1762166816.939522:0:32213:0:(tgt_mount.c:2557:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1762166816.939591:0:32223:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32223:1847765446850560:0@lo:104: 00010000:00010000:1.0:1762166816.939592:0:8397:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1762166816.939607:0:8397:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+3:32223:x1847765446850560:12345-0@lo:104: Request processed in 181us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.939614:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1762166816.939619:0:32223:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.939641:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166816.939648:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.939654:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0a00 already unused, calling callback (ffffffffc12c3c20) 10000000:00010000:1.0:1762166816.939658:0:7420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.939664:0:7420:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1762166816.939669:0:7420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166816.939673:0:7420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1762166816.939707:0:7420:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.939712:0:7420:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166816.939734:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.939740:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff945bc95c0a00/0x2f180c4effb0cce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0cce8 expref: -99 pid: 32213 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166816.939747:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446850688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166816.939788:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166816.939790:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166816.939795:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166816.939802:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.939840:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446850688 00000100:00100000:1.0:1762166816.939847:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446850688 00010000:00010000:1.0:1762166816.939888:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 10 pid: 32222 timeout: 536 lvb_type: 0 00000100:00100000:1.0:1762166816.939926:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1762166816.939936:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:3635:x1847765446850688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166816.939951:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166816.939958:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 10 pid: 32222 timeout: 536 lvb_type: 0 00010000:00010000:1.0:1762166816.939969:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 10 pid: 32222 timeout: 536 lvb_type: 0 00010000:00010000:1.0:1762166816.939985:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0cce1 expref: 10 pid: 32222 timeout: 536 lvb_type: 0 00010000:00010000:1.0:1762166816.940002:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.940011:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 20000000:01000000:1.0:1762166816.940025:0:7421:0:(mgs_nids.c:679:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001039320s 00010000:00010000:1.0:1762166816.940029:0:7421:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.940035:0:7421:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.940048:0:7421:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.940054:0:7421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.940060:0:7421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166816.940065:0:7421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.940073:0:7421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.940093:0:7421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166816.940102:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166816.940133:0:32223:0:(ldlm_request.c:183:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166816.940141:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:3635:x1847765446850688:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.940161:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00010000:00010000:2.0:1762166816.940171:0:32223:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166816.940180:0:32223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd19 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32223 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166816.940194:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446850688:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1762166816.946598:0:32213:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 52 00000040:01000000:3.0:1762166816.946778:0:32213:0:(llog_obd.c:195:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1762166816.946784:0:32243:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 52 00000020:00080000:2.0:1762166816.946788:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 52 00000040:01000000:3.0:1762166816.946969:0:32244:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1762166816.946972:0:32213:0:(llog_obd.c:195:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1762166816.947232:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446850816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.947296:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.947333:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.947348:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446850816 00000100:00100000:1.0:1762166816.947356:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446850816 00000040:01000000:2.0:1762166816.947392:0:32213:0:(llog_obd.c:195:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:1.0:1762166816.947404:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1762166816.947416:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446850816:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1762166816.947419:0:32213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1762166816.947522:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446850816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.947531:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1762166816.947545:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446850816:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1762166816.947573:0:32245:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1762166816.947597:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446850944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.947629:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.947651:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.947651:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446850944 00000100:00100000:1.0:1762166816.947661:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446850944 00000100:00100000:1.0:1762166816.947685:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1762166816.947693:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446850944:12345-0@lo:1000:lod0000_rec0001.0 00000004:00000080:2.0:1762166816.947763:0:32213:0:(mdd_device.c:556:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1762166816.947770:0:32213:0:(llog_obd.c:195:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1762166816.947800:0:32213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1762166816.947800:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446850944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.947809:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1762166816.947813:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446850944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.947885:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.947912:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.947933:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.947943:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446851072 00000100:00100000:1.0:1762166816.947948:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446851072 00000100:00100000:1.0:1762166816.947970:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1762166816.947977:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1762166816.948021:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 44us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.948028:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1762166816.948041:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.948091:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.948140:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.948162:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.948162:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446851200 00000100:00100000:1.0:1762166816.948167:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446851200 00000100:00100000:1.0:1762166816.948196:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1762166816.948205:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851200:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1762166816.948275:0:32244:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x200000400:0x1:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1762166816.948362:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851200:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 158us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.948369:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1762166816.948376:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851200:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1762166816.948408:0:32245:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 0, last_idx 2 00000100:00100000:3.0:1762166816.948500:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.948552:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.948576:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.948621:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446851328 00000100:00100000:1.0:1762166816.948626:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446851328 00000100:00100000:1.0:1762166816.948651:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1762166816.948659:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1762166816.948791:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 132us (240us total) trans 0 rc 0/0 00000040:00080000:0.0:1762166816.948797:0:32244:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:1.0:1762166816.948801:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1762166816.948803:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851328:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1762166816.948804:0:32244:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x200000400:0x2:0x0] at index 1 of catalog [0x200000400:0x1:0x0] 00000040:00080000:2.0:1762166816.948820:0:32213:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1762166816.948843:0:32245:0:(llog.c:797:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:3.0:1762166816.948852:0:32245:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x240000401:0x3:0x0] at index 1 of catalog [0x240000401:0x1:0x0] 00000100:00100000:3.0:1762166816.948903:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.948934:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.948952:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.948962:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446851456 00000100:00100000:1.0:1762166816.948967:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446851456 00000100:00100000:1.0:1762166816.948989:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1762166816.948996:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1762166816.949043:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.949050:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1762166816.949056:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.949117:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851584:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.949156:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.949173:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.949182:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446851584 00000100:00100000:1.0:1762166816.949186:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446851584 00000100:00100000:1.0:1762166816.949207:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1762166816.949214:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851584:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1762166816.949221:0:32213:0:(llog.c:854:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1762166816.949254:0:32213:0:(llog_obd.c:195:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1762166816.949302:0:32213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1762166816.949384:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851584:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 169us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.949392:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1762166816.949398:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851584:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.949459:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851712:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1762166816.949520:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166816.949537:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166816.949548:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446851712 00000100:00100000:1.0:1762166816.949553:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446851712 00000100:00100000:1.0:1762166816.949582:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1762166816.949591:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851712:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1762166816.949644:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446851712:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166816.949652:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1762166816.949657:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446851712:0@lo:1000:lod0000_rec0001.0 00000004:00080000:3.0:1762166816.949690:0:32245:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc2d93000 with version 1 00000040:00080000:3.0:1762166816.949708:0:32245:0:(llog_cat.c:1211:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 1, last_idx 2 00000004:00080000:0.0:1762166816.949709:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 1 rpc_version 1 00000004:00080000:3.0:1762166816.949720:0:32245:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc2d93e40 with version 2 00000040:00080000:3.0:1762166816.949724:0:32245:0:(llog_cat.c:1254:llog_cat_cleanup()) cancel plain log [0x240000401:0x3:0x0] at index 1 of catalog [0x240000401:0x1:0x0] 00000020:00100000:0.0:1762166816.949744:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166816.949752:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bcbe31880 x1847765446851968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166816.949764:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446851968:0@lo:1000:osp_up1-0.0 00080000:10000000:2.0:1762166816.949769:0:32213:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000100:00100000:0.0:1762166816.949792:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.949809:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166816.949822:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446851968 00000100:00100000:0.0:1762166816.949825:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446851968 00000100:00100000:0.0:1762166816.949856:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1762166816.949862:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32229:x1847765446851968:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1762166816.950606:0:32244:0:(lod_dev.c:317:lod_process_recovery_updates()) lustre-MDT0000-mdtlov: process recovery updates [0x200000400:0x2:0x0].29 00000020:00080000:1.0:1762166816.950612:0:32244:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0000: insert record batchid = 52 transno = 0 mdt_index 0 00000001:00080000:3.0:1762166816.950621:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967471 is committed 00000040:00080000:1.0:1762166816.950625:0:32244:0:(llog.c:854:llog_process_thread()) stop processing plain [0x200000400:0x2:0x0] index 30 count 2 00000001:00100000:3.0:1762166816.950628:0:7412:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1762166816.950641:0:32244:0:(llog.c:854:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 2 count 2 00000004:00080000:1.0:1762166816.950688:0:32244:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00080000:0.0:1762166816.950959:0:32213:0:(ldlm_lib.c:3032:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 4294969035 00000100:00100000:2.0:1762166816.951020:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:32229:x1847765446851968:12345-0@lo:1000:osp_up1-0.0 Request processed in 1156us (1224us total) trans 4294967471 rc 0/0 00000004:00080000:0.0:1762166816.951028:0:32229:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967471 committed transno 4294967471 00000100:00100000:2.0:1762166816.951031:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1762166816.951033:0:32229:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967471 gen 2 00000100:00100000:0.0:1762166816.951057:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446851968:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1762166816.951074:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 2 rpc_version 2 00000020:00100000:0.0:1762166816.951087:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166816.951091:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bcbe31880 x1847765446852224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166816.951102:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446852224:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166816.951123:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.951139:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc322d480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166816.951149:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446852224 00000100:00100000:2.0:1762166816.951153:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446852224 00000100:00100000:2.0:1762166816.951174:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1762166816.951179:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:32229:x1847765446852224:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166816.951250:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32229:x1847765446852224:12345-0@lo:1000:osp_up1-0.0 Request processed in 70us (125us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1762166816.951255:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1762166816.951272:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446852224:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166816.951308:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dde680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446852352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1762166816.951355:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.951375:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166816.951384:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446852352 00000100:00100000:2.0:1762166816.951387:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446852352 00000100:00100000:2.0:1762166816.951407:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1762166816.951411:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446852352:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:3.0:1762166816.951420:0:32246:0:(ldlm_lib.c:2835:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 32246 00010000:00080000:3.0:1762166816.951432:0:32246:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1762166816.951435:0:32246:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1762166816.951470:0:32213:0:(tgt_mount.c:299:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1762166816.951504:0:32213:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1762166816.951528:0:32213:0:(tgt_mount.c:2326:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1762166816.951537:0:32213:0:(super25.c:202:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000100:00100000:2.0:1762166816.951541:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446852352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 127us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166816.951546:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1762166816.951560:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dde680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446852352:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1762166816.951594:0:32245:0:(llog.c:797:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1762166816.951598:0:32245:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x240000401:0x4:0x0] at index 2 of catalog [0x240000401:0x1:0x0] 00000100:00100000:1.0:1762166816.951631:0:32245:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dde680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446852480:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1762166816.951660:0:32245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166816.951701:0:32245:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166816.953562:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446852480 00000100:00100000:0.0:1762166816.953568:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446852480 00000100:00100000:0.0:1762166816.953598:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1762166816.953607:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446852480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1762166816.953685:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32245:x1847765446852480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166816.953691:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1762166816.953707:0:32245:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dde680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:32245:1847765446852480:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1762166816.953761:0:32245:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1762166816.953795:0:32245:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc10de9c0 with version 3 00000004:00080000:1.0:1762166816.953840:0:32245:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc10de480 with version 4 00000004:00080000:0.0:1762166816.953842:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 3 rpc_version 3 00000040:00080000:1.0:1762166816.953847:0:32245:0:(llog_cat.c:1254:llog_cat_cleanup()) cancel plain log [0x240000401:0x4:0x0] at index 2 of catalog [0x240000401:0x1:0x0] 00000020:00100000:0.0:1762166816.953863:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000040:00080000:1.0:1762166816.953864:0:32245:0:(llog.c:854:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 2 count 1 00000100:00100000:0.0:1762166816.953890:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bcbe33b80 x1847765446852736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166816.953907:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe33b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446852736:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1762166816.953932:0:32245:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1762166816.953937:0:32245:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1762166816.953943:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.953995:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eee300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166816.954016:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446852736 00000100:00100000:0.0:1762166816.954021:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446852736 00000100:00100000:0.0:1762166816.954050:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1762166816.954058:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:32229:x1847765446852736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166816.954278:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:32229:x1847765446852736:12345-0@lo:1000:osp_up1-0.0 Request processed in 221us (338us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1762166816.954286:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1762166816.954327:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe33b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446852736:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1762166816.954335:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 4 rpc_version 4 00000020:00100000:0.0:1762166816.954346:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166816.954351:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bcbe32d80 x1847765446852992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166816.954365:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe32d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446852992:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166816.954391:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166816.954404:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eee300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166816.954416:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446852992 00000100:00100000:0.0:1762166816.954420:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446852992 00000100:00100000:0.0:1762166816.954444:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1762166816.954450:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:32229:x1847765446852992:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166816.954554:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:32229:x1847765446852992:12345-0@lo:1000:osp_up1-0.0 Request processed in 104us (163us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1762166816.954570:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1762166816.954606:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe32d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446852992:0@lo:1000:osp_up1-0.0 00010000:00080000:0.0:1762166816.957538:0:32246:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:1.0:1762166816.959675:0:32247:0:(tgt_mount.c:2194:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1762166816.960144:0:32247:0:(tgt_mount.c:2225:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1762166817.619690:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1762166818.335097:0:32472:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1762166818.578744:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446853120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166818.578865:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166818.578939:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446853120 00000100:00100000:3.0:1762166818.578959:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446853120 00000100:00100000:3.0:1762166818.579067:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1762166818.579069:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166818.579100:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446853120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1762166818.579129:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51822272 pending 0 free 3921379328 avail 3689857024 00000100:00100000:3.0:1762166818.579236:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446853120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.579243:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1762166818.579320:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446853120:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1762166818.642685:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1762166818.708821:0:32524:0:(tgt_mount.c:2194:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1762166818.709027:0:32524:0:(tgt_mount.c:2225:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1762166818.834663:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1762166818.834672:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-mdtir-ffff945cc7d3c800 from 14 10000000:01000000:0.0:1762166818.834677:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1762166818.834777:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c0c00/0x2f180c4effb0cd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166818.834788:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bc95c0c00/0x2f180c4effb0cd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166818.834798:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bc95c0c00/0x2f180c4effb0cd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166818.834823:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1762166818.834900:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166818.834971:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166818.834977:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446853248 00000100:00100000:1.0:1762166818.834995:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446853248 00000100:00100000:1.0:1762166818.835070:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1762166818.835086:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+9:6491:x1847765446853248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.835125:0:32221:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166818.835151:0:32221:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e3c00/0x2f180c4effb0cd27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd20 expref: -99 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.835186:0:32221:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e3c00/0x2f180c4effb0cd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd20 expref: 10 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.835199:0:32221:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e3c00/0x2f180c4effb0cd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd20 expref: 10 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.835211:0:32221:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3c00, rc 0) 00000100:00100000:1.0:1762166818.835298:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:6491:x1847765446853248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166818.835307:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1762166818.835336:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166818.835358:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bc95c0c00/0x2f180c4effb0cd20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd27 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.835369:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bc95c0c00/0x2f180c4effb0cd20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd27 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166818.835427:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.835465:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.835538:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446853376 00000100:00100000:2.0:1762166818.835543:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166818.835545:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446853376 00000100:00100000:1.0:1762166818.835585:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1762166818.835594:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:6491:x1847765446853376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1762166818.835616:0:32221:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1762166818.835637:0:32221:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1762166818.835641:0:32221:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1762166818.835757:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:6491:x1847765446853376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166818.835767:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1762166818.835779:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1762166818.835853:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1762166818.835861:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc95c0c00/0x2f180c4effb0cd20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd27 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.835868:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bc95c0c00/0x2f180c4effb0cd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd27 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1762166818.835876:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1762166818.835878:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-client-ffff945bccb4b000 from 52 10000000:01000000:2.0:1762166818.835880:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1762166818.835898:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc5ae5c00/0x2f180c4effb0cd2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.835904:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bc5ae5c00/0x2f180c4effb0cd2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.835911:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bc5ae5c00/0x2f180c4effb0cd2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166818.835935:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.835966:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166818.835995:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166818.836059:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446853504 00000100:00100000:1.0:1762166818.836066:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446853504 00000100:00100000:1.0:1762166818.836129:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1762166818.836140:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+10:6491:x1847765446853504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.836156:0:32221:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166818.836178:0:32221:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cd35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd2e expref: -99 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.836201:0:32221:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cd35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd2e expref: 11 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.836211:0:32221:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bcc9e3400/0x2f180c4effb0cd35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd2e expref: 11 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.836221:0:32221:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc9e3400, rc 0) 00000100:00100000:1.0:1762166818.836269:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+11:6491:x1847765446853504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166818.836277:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1762166818.836364:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166818.836375:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bc5ae5c00/0x2f180c4effb0cd2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd35 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.836382:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bc5ae5c00/0x2f180c4effb0cd2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd35 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166818.836438:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.836461:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166818.836521:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.836588:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446853632 00000100:00100000:3.0:1762166818.836592:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446853632 00000100:00100000:3.0:1762166818.836631:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1762166818.836649:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+11:6491:x1847765446853632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.836776:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+11:6491:x1847765446853632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.836783:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1762166818.836817:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.836859:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.836894:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166818.836918:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.837355:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446853760 00000100:00100000:3.0:1762166818.837360:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446853760 00000100:00100000:3.0:1762166818.837386:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1762166818.837393:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+11:6491:x1847765446853760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.837495:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+11:6491:x1847765446853760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.837503:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1762166818.837533:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166818.838253:0:32544:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1762166818.838386:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1762166818.838412:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1762166818.838422:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc5ae5c00/0x2f180c4effb0cd2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd35 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.838432:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bc5ae5c00/0x2f180c4effb0cd2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd35 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1762166818.838452:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1762166818.838454:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1762166818.838457:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1762166818.838505:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc37b6c00/0x2f180c4effb0cd3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.838513:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bc37b6c00/0x2f180c4effb0cd3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.838523:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bc37b6c00/0x2f180c4effb0cd3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166818.838539:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.838568:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166818.838602:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.838634:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446853888 00000100:00100000:2.0:1762166818.838639:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446853888 00000100:00100000:2.0:1762166818.838673:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1762166818.838680:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+11:6491:x1847765446853888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166818.838688:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166818.838704:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc5ae5200/0x2f180c4effb0cd43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd3c expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.838720:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc5ae5200/0x2f180c4effb0cd43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd3c expref: 12 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.838729:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc5ae5200/0x2f180c4effb0cd43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd3c expref: 12 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.838736:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae5200, rc 0) 00000100:00100000:2.0:1762166818.838770:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+12:6491:x1847765446853888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.838776:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1762166818.838804:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446853888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166818.838817:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bc37b6c00/0x2f180c4effb0cd3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd43 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.838826:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bc37b6c00/0x2f180c4effb0cd3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd43 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166818.838886:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.838923:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166818.838950:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166818.839006:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446854016 00000100:00100000:1.0:1762166818.839019:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446854016 00000100:00100000:1.0:1762166818.839078:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1762166818.839087:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+12:6491:x1847765446854016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.839268:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+12:6491:x1847765446854016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166818.839276:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1762166818.839334:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.839384:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.839439:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166818.839462:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166818.839474:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446854144 00000100:00100000:1.0:1762166818.839564:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446854144 00000100:00100000:2.0:1762166818.839619:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1762166818.839632:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+12:6491:x1847765446854144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.841652:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+12:6491:x1847765446854144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2021us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.841660:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1762166818.841792:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1762166818.842616:0:32545:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1762166818.842729:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1762166818.842756:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1762166818.842767:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bc37b6c00/0x2f180c4effb0cd3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd43 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.842779:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bc37b6c00/0x2f180c4effb0cd3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd43 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.842799:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1762166818.842801:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log params-ffff945bccb4b000 from 7 10000000:01000000:1.0:1762166818.842803:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1762166818.842853:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb0cd4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.842861:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb0cd4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.842870:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb0cd4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.842895:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.842953:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.842997:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.843009:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446854272 00000100:00100000:2.0:1762166818.843018:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446854272 00000100:00100000:2.0:1762166818.843057:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1762166818.843066:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+12:6491:x1847765446854272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166818.843079:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166818.843093:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc5ae4e00/0x2f180c4effb0cd51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd4a expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.843114:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc5ae4e00/0x2f180c4effb0cd51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd4a expref: 13 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.843124:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc5ae4e00/0x2f180c4effb0cd51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd4a expref: 13 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.843139:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4e00, rc 0) 00000100:00100000:2.0:1762166818.843185:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+13:6491:x1847765446854272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.843191:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1762166818.843352:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.843368:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb0cd4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd51 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.843377:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb0cd4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd51 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.843432:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.843458:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.843539:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.843552:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446854400 00000100:00100000:2.0:1762166818.843560:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446854400 00000100:00100000:2.0:1762166818.843603:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1762166818.843612:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+13:6491:x1847765446854400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.843747:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+13:6491:x1847765446854400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.843755:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1762166818.843772:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.843801:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.843857:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.843879:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.843906:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446854528 00000100:00100000:2.0:1762166818.843910:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446854528 00000100:00100000:2.0:1762166818.843931:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1762166818.843936:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+13:6491:x1847765446854528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.844003:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+13:6491:x1847765446854528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.844009:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1762166818.844019:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166818.844850:0:32546:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1762166818.844922:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1762166818.844944:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1762166818.844950:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb0cd4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd51 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.844958:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2000/0x2f180c4effb0cd4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd51 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.844965:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1762166818.844966:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-client-ffff945bc4176000 from 52 10000000:01000000:1.0:1762166818.844968:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1762166818.844987:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3000/0x2f180c4effb0cd58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.844992:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3000/0x2f180c4effb0cd58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.844998:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3000/0x2f180c4effb0cd58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.845009:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.845039:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.845067:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.845132:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446854656 00000100:00100000:2.0:1762166818.845139:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446854656 00000100:00100000:2.0:1762166818.845173:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1762166818.845183:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+13:6491:x1847765446854656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166818.845194:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166818.845207:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd58 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.845241:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd58 expref: 14 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.845251:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc5ae4c00/0x2f180c4effb0cd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd58 expref: 14 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.845260:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4c00, rc 0) 00000100:00100000:2.0:1762166818.845295:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+14:6491:x1847765446854656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.845304:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1762166818.845308:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.845320:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3000/0x2f180c4effb0cd58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd5f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.845333:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3000/0x2f180c4effb0cd58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd5f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.845366:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.845384:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.845396:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.845407:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446854784 00000100:00100000:2.0:1762166818.845412:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446854784 00000100:00100000:2.0:1762166818.845437:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1762166818.845445:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+14:6491:x1847765446854784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.845580:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+14:6491:x1847765446854784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.845587:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1762166818.845624:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.845660:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.845698:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.845732:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.845733:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446854912 00000100:00100000:2.0:1762166818.845739:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446854912 00000100:00100000:2.0:1762166818.845764:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1762166818.845772:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+14:6491:x1847765446854912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.845857:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+14:6491:x1847765446854912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.845865:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1762166818.845869:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446854912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166818.846582:0:32547:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1762166818.846684:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1762166818.846716:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1762166818.846724:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3000/0x2f180c4effb0cd58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd5f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.846732:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3000/0x2f180c4effb0cd58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd5f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.846739:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1762166818.846741:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1762166818.846744:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1762166818.846776:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2c00/0x2f180c4effb0cd66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.846783:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2c00/0x2f180c4effb0cd66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.846804:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2c00/0x2f180c4effb0cd66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.846828:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.846889:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.846936:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.846974:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446855040 00000100:00100000:2.0:1762166818.846981:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446855040 00000100:00100000:2.0:1762166818.847031:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1762166818.847040:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+14:6491:x1847765446855040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166818.847052:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166818.847063:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc5ae5a00/0x2f180c4effb0cd6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd66 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.847082:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc5ae5a00/0x2f180c4effb0cd6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd66 expref: 15 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.847090:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc5ae5a00/0x2f180c4effb0cd6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd66 expref: 15 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.847098:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae5a00, rc 0) 00000100:00100000:2.0:1762166818.847137:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+15:6491:x1847765446855040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.847144:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1762166818.847172:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.847187:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2c00/0x2f180c4effb0cd66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd6d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.847195:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2c00/0x2f180c4effb0cd66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd6d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.847247:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.847277:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.847298:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.847314:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446855168 00000100:00100000:2.0:1762166818.847318:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446855168 00000100:00100000:2.0:1762166818.847357:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1762166818.847367:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+15:6491:x1847765446855168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.847510:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+15:6491:x1847765446855168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.847515:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1762166818.847542:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.847577:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.847616:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.847640:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.847649:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446855296 00000100:00100000:2.0:1762166818.847654:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446855296 00000100:00100000:2.0:1762166818.847682:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1762166818.847690:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+15:6491:x1847765446855296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.848259:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+15:6491:x1847765446855296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 570us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.848269:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1762166818.848297:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166818.848980:0:32548:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1762166818.849050:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1762166818.849073:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1762166818.849080:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2c00/0x2f180c4effb0cd66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd6d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.849100:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2c00/0x2f180c4effb0cd66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd6d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.849108:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1762166818.849110:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log params-ffff945bc4176000 from 7 10000000:01000000:1.0:1762166818.849112:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1762166818.849129:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3a00/0x2f180c4effb0cd74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.849136:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3a00/0x2f180c4effb0cd74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.849145:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3a00/0x2f180c4effb0cd74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.849159:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.849187:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.849213:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.849226:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446855424 00000100:00100000:2.0:1762166818.849232:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446855424 00000100:00100000:2.0:1762166818.849261:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1762166818.849268:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+15:6491:x1847765446855424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166818.849278:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166818.849287:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc5ae5400/0x2f180c4effb0cd7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd74 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.849304:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc5ae5400/0x2f180c4effb0cd7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd74 expref: 16 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.849312:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc5ae5400/0x2f180c4effb0cd7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd74 expref: 16 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.849319:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae5400, rc 0) 00000100:00100000:2.0:1762166818.849350:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+16:6491:x1847765446855424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.849357:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1762166818.849372:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.849384:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3a00/0x2f180c4effb0cd74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd7b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.849392:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3a00/0x2f180c4effb0cd74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd7b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.849428:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.849452:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.849471:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166818.849474:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446855552 00000100:00100000:2.0:1762166818.849680:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446855552 00000100:00100000:2.0:1762166818.849706:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1762166818.849713:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+16:6491:x1847765446855552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.849785:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+16:6491:x1847765446855552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166818.849793:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1762166818.849810:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.849861:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.849901:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.849926:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.849962:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446855680 00000100:00100000:3.0:1762166818.849974:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446855680 00000100:00100000:3.0:1762166818.850020:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1762166818.850032:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6ca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+16:6491:x1847765446855680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.850179:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6ca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+16:6491:x1847765446855680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.850188:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1762166818.850206:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1762166818.850996:0:32549:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1762166818.851070:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1762166818.851105:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1762166818.851114:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3a00/0x2f180c4effb0cd74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd7b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.851122:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3a00/0x2f180c4effb0cd74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd7b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.851130:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1762166818.851132:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-client-ffff945cee00c800 from 52 10000000:01000000:1.0:1762166818.851134:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1762166818.851149:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2a00/0x2f180c4effb0cd82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.851156:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2a00/0x2f180c4effb0cd82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.851163:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2a00/0x2f180c4effb0cd82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.851176:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.851206:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.851234:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.851370:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446855808 00000100:00100000:3.0:1762166818.851376:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446855808 00000100:00100000:3.0:1762166818.851412:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1762166818.851422:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+16:6491:x1847765446855808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166818.851431:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166818.851442:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b7c00/0x2f180c4effb0cd89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd82 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.851459:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b7c00/0x2f180c4effb0cd89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd82 expref: 17 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.851519:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b7c00/0x2f180c4effb0cd89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd82 expref: 17 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.851528:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7c00, rc 0) 00000100:00100000:3.0:1762166818.851573:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+17:6491:x1847765446855808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.851586:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1762166818.851626:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166818.851640:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2a00/0x2f180c4effb0cd82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd89 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166818.851647:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2a00/0x2f180c4effb0cd82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd89 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166818.851678:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.851696:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166818.851714:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.851735:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446855936 00000100:00100000:3.0:1762166818.851741:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446855936 00000100:00100000:3.0:1762166818.851767:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1762166818.851774:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+17:6491:x1847765446855936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.851869:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6caac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+17:6491:x1847765446855936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.851878:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1762166818.851888:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446855936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.851916:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1762166818.851941:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166818.851954:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.851971:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446856064 00000100:00100000:3.0:1762166818.851984:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446856064 00000100:00100000:3.0:1762166818.852013:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1762166818.852020:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6ca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+17:6491:x1847765446856064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.852090:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6ca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+17:6491:x1847765446856064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.852098:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1762166818.852109:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1762166818.852765:0:32550:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1762166818.852821:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1762166818.852889:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1762166818.852900:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2a00/0x2f180c4effb0cd82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd89 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.852907:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2a00/0x2f180c4effb0cd82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd89 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.852914:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1762166818.852916:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-mdtir-ffff945cee00c800 from 14 10000000:01000000:1.0:1762166818.852918:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1762166818.852932:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3600/0x2f180c4effb0cd90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.852938:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3600/0x2f180c4effb0cd90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.852946:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3600/0x2f180c4effb0cd90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.852958:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.852981:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.853008:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.853055:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446856192 00000100:00100000:3.0:1762166818.853060:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446856192 00000100:00100000:3.0:1762166818.853086:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1762166818.853095:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+17:6491:x1847765446856192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166818.853103:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166818.853112:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b7400/0x2f180c4effb0cd97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd90 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.853126:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b7400/0x2f180c4effb0cd97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd90 expref: 18 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.853133:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b7400/0x2f180c4effb0cd97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd90 expref: 18 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.853145:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7400, rc 0) 00000100:00100000:3.0:1762166818.853177:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+18:6491:x1847765446856192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.853184:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1762166818.853188:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.853199:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3600/0x2f180c4effb0cd90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd97 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.853204:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3600/0x2f180c4effb0cd90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cd97 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.853232:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.853252:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.853269:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.853287:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446856320 00000100:00100000:3.0:1762166818.853291:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446856320 00000100:00100000:3.0:1762166818.853319:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1762166818.853328:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+18:6491:x1847765446856320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1762166818.853339:0:32222:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1762166818.853352:0:32222:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1762166818.853355:0:32222:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1762166818.853437:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+18:6491:x1847765446856320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166818.853441:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.853450:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 10000000:01000000:1.0:1762166818.853498:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1762166818.853504:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3600/0x2f180c4effb0cd90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd97 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.853511:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bcc9e3600/0x2f180c4effb0cd90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cd97 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.853518:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1762166818.853520:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1762166818.853522:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1762166818.853534:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2200/0x2f180c4effb0cd9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.853539:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2200/0x2f180c4effb0cd9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.853543:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2200/0x2f180c4effb0cd9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.853550:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.853566:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.853583:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.853596:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446856448 00000100:00100000:3.0:1762166818.853601:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446856448 00000100:00100000:3.0:1762166818.853631:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1762166818.853639:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+18:6491:x1847765446856448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166818.853646:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166818.853653:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b7600/0x2f180c4effb0cda5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cd9e expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.853666:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b7600/0x2f180c4effb0cda5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cd9e expref: 19 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.853674:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b7600/0x2f180c4effb0cda5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cd9e expref: 19 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.853689:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7600, rc 0) 00000100:00100000:3.0:1762166818.853726:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+19:6491:x1847765446856448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166818.853727:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.853738:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1762166818.853738:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2200/0x2f180c4effb0cd9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cda5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.853747:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2200/0x2f180c4effb0cd9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cda5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.853784:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.853801:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.853813:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.853821:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446856576 00000100:00100000:3.0:1762166818.853826:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446856576 00000100:00100000:3.0:1762166818.853862:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1762166818.853870:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf78d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+19:6491:x1847765446856576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.853961:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf78d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+19:6491:x1847765446856576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166818.853964:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.853981:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1762166818.853988:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.854023:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.854038:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.854042:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446856704 00000100:00100000:3.0:1762166818.854047:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446856704 00000100:00100000:3.0:1762166818.854069:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1762166818.854076:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf78d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+19:6491:x1847765446856704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.854784:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf78d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+19:6491:x1847765446856704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 708us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.854791:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1762166818.854820:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1762166818.855512:0:32551:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1762166818.855573:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1762166818.855595:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1762166818.855602:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2200/0x2f180c4effb0cd9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cda5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.855610:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945bcc9e2200/0x2f180c4effb0cd9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cda5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.855617:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1762166818.855618:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-barrier-ffff945cee00c800 from 1 10000000:01000000:1.0:1762166818.855621:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1762166818.855637:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945d00f14800/0x2f180c4effb0cdac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.855644:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945d00f14800/0x2f180c4effb0cdac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.855651:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945d00f14800/0x2f180c4effb0cdac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.855669:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.855688:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.855715:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.855721:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446856832 00000100:00100000:3.0:1762166818.855727:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446856832 00000100:00100000:3.0:1762166818.855761:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1762166818.855770:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf78d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+19:6491:x1847765446856832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166818.855779:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166818.855788:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b6800/0x2f180c4effb0cdb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cdac expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.855810:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b6800/0x2f180c4effb0cdb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cdac expref: 20 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.855818:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b6800/0x2f180c4effb0cdb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cdac expref: 20 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.855824:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b6800, rc 0) 00000100:00100000:3.0:1762166818.855867:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf78d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+20:6491:x1847765446856832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.855874:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1762166818.855896:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.855905:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945d00f14800/0x2f180c4effb0cdac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdb3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.855910:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945d00f14800/0x2f180c4effb0cdac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cdb3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.855918:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1762166818.855920:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945d00f14800/0x2f180c4effb0cdac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdb3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.855924:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945d00f14800/0x2f180c4effb0cdac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdb3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.855928:0:6491:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1762166818.855929:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log nodemap-ffff945cc7c1b1b0 from 1 10000000:01000000:1.0:1762166818.855931:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1762166818.855941:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945d00f15c00/0x2f180c4effb0cdba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.855945:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945d00f15c00/0x2f180c4effb0cdba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.855949:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945d00f15c00/0x2f180c4effb0cdba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.855956:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.855976:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.855990:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.856009:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446856960 00000100:00100000:3.0:1762166818.856014:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446856960 00000100:00100000:3.0:1762166818.856042:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1762166818.856052:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf78d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+20:6491:x1847765446856960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166818.856058:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166818.856067:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b6200/0x2f180c4effb0cdc1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cdba expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.856080:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b6200/0x2f180c4effb0cdc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cdba expref: 21 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.856087:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b6200/0x2f180c4effb0cdc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cdba expref: 21 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.856094:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b6200, rc 0) 00000100:00100000:3.0:1762166818.856123:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf78d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+21:6491:x1847765446856960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.856130:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1762166818.856137:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446856960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.856148:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945d00f15c00/0x2f180c4effb0cdba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdc1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.856152:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945d00f15c00/0x2f180c4effb0cdba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cdc1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.856162:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1762166818.856165:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945d00f15c00/0x2f180c4effb0cdba lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdc1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.856168:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945d00f15c00/0x2f180c4effb0cdba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdc1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.856172:0:6491:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1762166818.856173:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log params-ffff945cee00c800 from 7 10000000:01000000:1.0:1762166818.856174:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1762166818.856182:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945d00f14600/0x2f180c4effb0cdc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.856186:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945d00f14600/0x2f180c4effb0cdc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.856190:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945d00f14600/0x2f180c4effb0cdc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.856197:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.856211:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.856233:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.856235:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446857088 00000100:00100000:3.0:1762166818.856240:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446857088 00000100:00100000:3.0:1762166818.856267:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1762166818.856275:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf78d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+21:6491:x1847765446857088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166818.856282:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166818.856289:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b6a00/0x2f180c4effb0cdcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cdc8 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.856302:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b6a00/0x2f180c4effb0cdcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cdc8 expref: 22 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.856310:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b6a00/0x2f180c4effb0cdcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cdc8 expref: 22 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.856317:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b6a00, rc 0) 00000100:00100000:3.0:1762166818.856348:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf78d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:6491:x1847765446857088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166818.856354:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.856358:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:1.0:1762166818.856364:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945d00f14600/0x2f180c4effb0cdc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdcf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.856370:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945d00f14600/0x2f180c4effb0cdc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cdcf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.856397:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.856414:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166818.856428:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.856430:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446857216 00000100:00100000:3.0:1762166818.856435:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446857216 00000100:00100000:3.0:1762166818.856456:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1762166818.856462:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf78d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:6491:x1847765446857216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.856572:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf78d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:6491:x1847765446857216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.856579:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1762166818.856604:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.856638:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.856673:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166818.856692:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446857344 00000100:00100000:3.0:1762166818.856695:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446857344 00000100:00100000:1.0:1762166818.856700:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.856724:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1762166818.856728:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf78d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:6491:x1847765446857344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.856786:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf78d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:6491:x1847765446857344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.856795:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1762166818.856806:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1762166818.857410:0:32552:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1762166818.857467:0:6491:0:(obd_config.c:2039:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1762166818.857516:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1762166818.857523:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945d00f14600/0x2f180c4effb0cdc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdcf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.857532:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945d00f14600/0x2f180c4effb0cdc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cdcf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1762166818.857540:0:6491:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1762166818.857542:0:6491:0:(mgc_request.c:1812:mgc_process_log()) Process log lustre-sptlrpc-ffff945cc7c1b1b0 from 1 10000000:01000000:1.0:1762166818.857544:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1762166818.857557:0:6491:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff945d00f15800/0x2f180c4effb0cdd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.857569:0:6491:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff945d00f15800/0x2f180c4effb0cdd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.857577:0:6491:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff945d00f15800/0x2f180c4effb0cdd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.857589:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.857613:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166818.857639:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446857472 00000100:00100000:3.0:1762166818.857644:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446857472 00000100:00100000:1.0:1762166818.857652:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.857680:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1762166818.857687:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf78d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+22:6491:x1847765446857472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166818.857694:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166818.857703:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b6e00/0x2f180c4effb0cddd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0cdd6 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.857718:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b6e00/0x2f180c4effb0cddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0cdd6 expref: 23 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.857727:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b6e00/0x2f180c4effb0cddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0cdd6 expref: 23 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166818.857733:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b6e00, rc 0) 00000100:00100000:3.0:1762166818.857765:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf78d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:6491:x1847765446857472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166818.857771:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1762166818.857801:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1762166818.857813:0:6491:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff945d00f15800/0x2f180c4effb0cdd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cddd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.857823:0:6491:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff945d00f15800/0x2f180c4effb0cdd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0cddd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166818.857876:0:6491:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1762166818.857901:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166818.857922:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446857600 00000100:00100000:1.0:1762166818.857924:0:6491:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166818.857925:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446857600 00000100:00100000:3.0:1762166818.857948:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1762166818.857952:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:6491:x1847765446857600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166818.857991:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:6491:x1847765446857600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 39us (91us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166818.858003:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1762166818.858025:0:6491:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5309af7-bf8a-40d1-8f22-842c4953c1ea:6491:1847765446857600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1762166818.858047:0:6491:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1762166818.858052:0:6491:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff945d00f15800/0x2f180c4effb0cdd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cddd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166818.858060:0:6491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff945d00f15800/0x2f180c4effb0cdd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0cddd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166818.962688:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000004:00080000:2.0:1762166818.962739:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000100:00100000:1.0:1762166818.962759:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446857728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166818.962788:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446857856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166818.962847:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166818.962904:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446857728 00000100:00100000:2.0:1762166818.962923:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446857728 00000100:00080000:1.0:1762166818.962987:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166818.962989:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1762166818.963000:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446857728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166818.963025:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166818.963237:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446857728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (389us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762166818.963245:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1762166818.963264:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446857856 00000100:00100000:2.0:1762166818.963268:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446857856 00000004:00080000:3.0:1762166818.963271:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406e300, transno 0 00000004:00080000:3.0:1762166818.963280:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406e300/1, rc -22, transno 0 00000100:00100000:3.0:1762166818.963299:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446857728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166818.963302:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1762166818.963314:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446857856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166818.963394:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446857856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (367us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762166818.963400:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000004:00080000:3.0:1762166818.963456:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406dc00, transno 0 00000004:00080000:3.0:1762166818.963460:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406dc00/1, rc -22, transno 0 00000100:00100000:3.0:1762166818.963504:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446857856:0@lo:2:osp-syn-1-0.0 00000020:00000004:3.0:1762166819.101767:0:32583:0:(tgt_mount.c:2194:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1762166819.101975:0:32583:0:(tgt_mount.c:2225:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1762166819.666645:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166820.109367:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166820.109433:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166820.109466:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166820.109543:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440142336 00000100:00100000:2.0:1762166820.109558:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166820.109560:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440142336 00000100:00100000:2.0:1762166820.109594:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440142592 00000100:00100000:2.0:1762166820.109604:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440142592 00000100:00100000:1.0:1762166820.109652:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440142208 00000100:00100000:1.0:1762166820.109656:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440142208 00000100:00100000:1.0:1762166820.109698:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 438 00000100:00100000:2.0:1762166820.109699:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 279 00000100:00100000:1.0:1762166820.109718:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440142336:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166820.109721:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440142592:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166820.109841:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2893 00000100:00100000:0.0:1762166820.109854:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2415:x1847765440142208:12345-192.168.204.38@tcp:38:kworker.0 00000100:00100000:3.0:1762166820.109872:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440142080 00000100:00100000:1.0:1762166820.109878:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440142336:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 163us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.109883:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440142080 00000100:00100000:2.0:1762166820.109885:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440142592:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 161us (407us total) trans 0 rc 0/0 00010000:00080000:0.0:1762166820.109885:0:6495:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e1e11365-ba0b-405b-99c9-a704373217f2' at ffff945bc43b5800, cookie 0x2f180c4effb0cc71 00000100:00100000:1.0:1762166820.109900:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 438 00010000:00080000:0.0:1762166820.109905:0:6495:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp recovering/t4294968919 exp ffff945bc43b5800 cur 439 last 1762166816 00000100:00100000:2.0:1762166820.109914:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 279 00010000:02000400:0.0:1762166820.109923:0:6495:0:(ldlm_lib.c:2019:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:3.0:1762166820.109942:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 57 00000100:00080000:1.0:1762166820.109945:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166820.109954:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2419:x1847765440142080:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:1.0:1762166820.109956:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00080000:3.0:1762166820.109966:0:32222:0:(tgt_handler.c:788:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.38@tcp 00000100:00100000:3.0:1762166820.110012:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2419:x1847765440142080:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 59us (453us total) trans 0 rc -107/-107 00000100:00100000:3.0:1762166820.110021:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 57 00010000:00080000:0.0:1762166820.115069:0:6495:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1762166820.115108:0:6495:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:01000000:0.0:1762166820.115136:0:6495:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf3cb6100 00000100:00080000:0.0:1762166820.115280:0:6495:0:(import.c:65:import_set_state_nolock()) ffff945cc2be7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1762166820.115354:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:2415:x1847765440142208:12345-192.168.204.38@tcp:38:kworker.0 Request processed in 5502us (5920us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166820.115362:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2893 00000100:00100000:2.0:1762166820.124521:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166820.124638:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440142464 00000100:00100000:1.0:1762166820.124655:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440142464 00000100:00080000:2.0:1762166820.124768:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166820.124775:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 280 00000100:00100000:1.0:1762166820.124792:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440142464:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166820.124938:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440142464:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 151us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166820.124947:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 280 00000100:00100000:2.0:1762166820.125150:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166820.125185:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166820.125294:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440078080 00000100:00100000:0.0:1762166820.125315:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440078080 00000100:00100000:3.0:1762166820.125324:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440142720 00000100:00100000:3.0:1762166820.125331:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440142720 00000100:00100000:3.0:1762166820.125393:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 58 00000100:00100000:0.0:1762166820.125393:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2894 00000100:00100000:3.0:1762166820.125412:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2415:x1847765440142720:12345-192.168.204.38@tcp:250:kworker.0 00000100:00100000:0.0:1762166820.125413:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+6:2415:x1847765440078080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00080000:0.0:1762166820.125434:0:6495:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969036, current: 4294968919, replaying 00010000:00010000:0.0:1762166820.125445:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00080000:3.0:1762166820.125448:0:32222:0:(ldlm_lib.c:1428:target_handle_connect()) MGS: connection from cc359222-7391-43f5-989b-bf5867ae8fd6@192.168.204.38@tcp t0 exp 0000000000000000 cur 439 last 0 00010000:00010000:0.0:1762166820.125471:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cdeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c2e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000020:00000080:3.0:1762166820.125512:0:32222:0:(genops.c:1402:class_connect()) connect: client cc359222-7391-43f5-989b-bf5867ae8fd6, cookie 0x2f180c4effb0cde4 00000020:01000000:3.0:1762166820.125534:0:32222:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf1db1d00 00000100:00080000:3.0:1762166820.125699:0:32222:0:(import.c:65:import_set_state_nolock()) ffff945bc5671000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166820.125805:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+4:2415:x1847765440142720:12345-192.168.204.38@tcp:250:kworker.0 Request processed in 399us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166820.125823:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 58 00000004:00080000:1.0:1762166820.126353:0:6495:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 788us 00000004:00200000:1.0:1762166820.136309:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3:0x0]: returning size 4096 00000004:00080000:1.0:1762166820.136350:0:6495:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000405:0x3:0x0], cookie = 0x2f180c4effb0bfc1 00000004:00080000:1.0:1762166820.136365:0:6495:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0x2f180c4effb0bfc1 in new mfd 00010000:00010000:1.0:1762166820.136617:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cdeb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c2e expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.136643:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc403ad00) 00010000:00010000:1.0:1762166820.136647:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166820.136652:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cdeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c2e expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.136679:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1a00, rc 0) 00000100:00100000:1.0:1762166820.136783:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:2415:x1847765440078080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 11377us (11596us total) trans 4294968919 rc 301/301 00000100:00100000:1.0:1762166820.136793:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2894 00000100:00100000:2.0:1762166820.146883:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166820.146972:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440084096 00000100:00100000:1.0:1762166820.146989:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440084096 00000100:00100000:1.0:1762166820.147072:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2895 00000100:00100000:1.0:1762166820.147083:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+7:2415:x1847765440084096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00080000:1.0:1762166820.147113:0:6495:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969036, current: 4294968927, replaying 00010000:00010000:1.0:1762166820.147128:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166820.147160:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cdf9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c9e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166820.147921:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x7:0x0]: returning size 4096 00000004:00080000:1.0:1762166820.147951:0:6495:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000405:0x7:0x0], cookie = 0x2f180c4effb0c1ab 00000004:00080000:1.0:1762166820.147954:0:6495:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0x2f180c4effb0c1ab in new mfd 00010000:00010000:1.0:1762166820.148058:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cdf9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c9e expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.148602:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd0738f00) 00010000:00010000:1.0:1762166820.148613:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166820.148626:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0cdf9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c9e expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.148656:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14c00, rc 0) 00000100:00100000:1.0:1762166820.148732:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:2415:x1847765440084096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1649us (1858us total) trans 4294968927 rc 301/301 00000100:00100000:1.0:1762166820.148742:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2895 00000100:00100000:2.0:1762166820.149990:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166820.150044:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440092032 00000100:00100000:1.0:1762166820.150055:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440092032 00000100:00100000:1.0:1762166820.150117:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2896 00000100:00100000:1.0:1762166820.150130:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+8:2415:x1847765440092032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00080000:1.0:1762166820.150152:0:6495:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969036, current: 4294968944, replaying 00010000:00010000:1.0:1762166820.150163:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166820.150187:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ce07 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d2a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166820.150726:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x8:0x0]: returning size 4096 00000004:00080000:1.0:1762166820.150745:0:6495:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000405:0x8:0x0], cookie = 0x2f180c4effb0c32c 00000004:00080000:1.0:1762166820.150748:0:6495:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0x2f180c4effb0c32c in new mfd 00010000:00010000:1.0:1762166820.150839:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ce07 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d2a expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.150856:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd0738c00) 00010000:00010000:1.0:1762166820.150860:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166820.150874:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0ce07 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d2a expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.150894:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15000, rc 0) 00000100:00100000:1.0:1762166820.150956:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:2415:x1847765440092032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 830us (973us total) trans 4294968944 rc 301/301 00000100:00100000:1.0:1762166820.150965:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2896 00000100:00100000:2.0:1762166820.151855:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166820.151896:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440131968 00000100:00100000:1.0:1762166820.151903:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440131968 00000100:00100000:1.0:1762166820.151935:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2897 00000100:00100000:1.0:1762166820.151943:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:2415:x1847765440131968:12345-192.168.204.38@tcp:101:filefrag.0 00010000:00080000:1.0:1762166820.151961:0:6495:0:(ldlm_lib.c:3207:target_queue_recovery_request()) Next recovery transno: 4294969036, current: 4294969016, replaying 00010000:00010000:1.0:1762166820.151970:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166820.151987:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ce15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f84 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166820.152114:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xc:0x0]: returning size 1048576 00000004:00080000:1.0:1762166820.152128:0:6495:0:(mdt_open.c:503:mdt_mfd_open()) orphan mfd not found, fid = [0x200000405:0xc:0x0], cookie = 0x2f180c4effb0ca80 00000004:00080000:1.0:1762166820.152129:0:6495:0:(mdt_open.c:507:mdt_mfd_open()) Store old cookie 0x2f180c4effb0ca80 in new mfd 00010000:00010000:1.0:1762166820.152200:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ce15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f84 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.152212:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738100) 00010000:00010000:1.0:1762166820.152215:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166820.152219:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0ce15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f84 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166820.152235:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15400, rc 0) 00000100:00100000:1.0:1762166820.152275:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2415:x1847765440131968:12345-192.168.204.38@tcp:101:filefrag.0 Request processed in 334us (424us total) trans 4294969016 rc 301/301 00000100:00100000:1.0:1762166820.152289:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2897 00000100:00100000:2.0:1762166820.154565:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166820.154607:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166820.154649:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166820.154698:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440142848 00000100:00100000:0.0:1762166820.154710:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440142976 00000100:00100000:1.0:1762166820.154715:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440142848 00000100:00100000:3.0:1762166820.154716:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440143104 00000100:00100000:0.0:1762166820.154720:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440142976 00000100:00100000:3.0:1762166820.154727:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440143104 00000100:00100000:2.0:1762166820.154746:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166820.154796:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440143232 00000100:00100000:3.0:1762166820.154800:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440143232 00000100:00100000:0.0:1762166820.154830:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2898 00000100:00100000:0.0:1762166820.154846:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2415:x1847765440143104:12345-192.168.204.38@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1762166820.154856:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2899 00000100:00100000:3.0:1762166820.154870:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2900 00000100:00100000:1.0:1762166820.154882:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2415:x1847765440142976:12345-192.168.204.38@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1762166820.154895:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2415:x1847765440142848:12345-192.168.204.38@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1762166820.154896:0:6496:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff945bc5bb9880 x1847765440143104/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:606/0 lens 328/0 e 0 to 0 dl 1762166831 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1762166820.154914:0:6495:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff945bc5bb8e00 x1847765440142976/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:606/0 lens 328/0 e 0 to 0 dl 1762166831 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1762166820.154917:0:7432:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff945bc406d880 x1847765440142848/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:606/0 lens 328/0 e 0 to 0 dl 1762166831 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166820.154932:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2415:x1847765440143104:12345-192.168.204.38@tcp:101:ldlm_lock_repla.0 Request processed in 85us (275us total) trans 0 rc 0/-999 00000100:00100000:2.0:1762166820.154967:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2901 00000100:00100000:3.0:1762166820.154978:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2415:x1847765440142848:12345-192.168.204.38@tcp:101:ldlm_lock_repla.0 Request processed in 86us (419us total) trans 0 rc 0/-999 00000100:00100000:0.0:1762166820.154985:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2898 00000100:00100000:1.0:1762166820.154993:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2415:x1847765440142976:12345-192.168.204.38@tcp:101:ldlm_lock_repla.0 Request processed in 115us (378us total) trans 0 rc 0/-999 00000100:00100000:2.0:1762166820.154994:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2415:x1847765440143232:12345-192.168.204.38@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1762166820.155003:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2900 00010000:00080000:0.0:1762166820.155019:0:32246:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1762166820.155028:0:6494:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff945bc5bbb480 x1847765440143232/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:606/0 lens 328/0 e 0 to 0 dl 1762166831 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166820.155029:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2899 00000100:00100000:2.0:1762166820.155057:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2415:x1847765440143232:12345-192.168.204.38@tcp:101:ldlm_lock_repla.0 Request processed in 75us (335us total) trans 0 rc 0/-999 00000100:00100000:2.0:1762166820.155065:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2901 00010000:00080000:0.0:1762166820.155068:0:32246:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1762166820.690779:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166821.138742:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446857984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166821.138845:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166821.138902:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446857984 00000100:00100000:3.0:1762166821.138916:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446857984 00000100:00080000:2.0:1762166821.138964:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166821.139013:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1762166821.139030:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446857984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1762166821.139074:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3922440192 avail 3690917888 00000100:00100000:3.0:1762166821.139149:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446857984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.139158:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1762166821.139229:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446857984:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1762166821.714678:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166821.773081:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.773215:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440143488 00000100:00100000:3.0:1762166821.773231:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440143488 00000100:00100000:3.0:1762166821.773327:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:3.0:1762166821.773341:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+4:39134:x1847765440143488:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166821.773365:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166821.773389:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b7800/0x2f180c4effb0ce23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8002 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.773427:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b7800/0x2f180c4effb0ce23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8002 expref: 5 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.773439:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b7800/0x2f180c4effb0ce23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8002 expref: 5 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.773451:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7800, rc 0) 00000100:00100000:3.0:1762166821.773566:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+5:39134:x1847765440143488:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 227us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.773576:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 59 00000100:00100000:1.0:1762166821.774370:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.774413:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440143616 00000100:00100000:3.0:1762166821.774418:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440143616 00000100:00100000:3.0:1762166821.774449:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:3.0:1762166821.774458:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+5:39134:x1847765440143616:12345-192.168.204.38@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1762166821.774496:0:32222:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1762166821.774518:0:32222:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1762166821.774522:0:32222:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1762166821.775234:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+5:39134:x1847765440143616:12345-192.168.204.38@tcp:256:ll_cfg_requeue.0 Request processed in 777us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.775241:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 60 00000100:00100000:2.0:1762166821.776262:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.776342:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440143744 00000100:00100000:3.0:1762166821.776351:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440143744 00000100:00100000:3.0:1762166821.776405:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:3.0:1762166821.776414:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+5:39134:x1847765440143744:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166821.776429:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166821.776444:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b7e00/0x2f180c4effb0ce2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8009 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.776469:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b7e00/0x2f180c4effb0ce2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8009 expref: 6 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.776506:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b7e00/0x2f180c4effb0ce2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8009 expref: 6 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.776514:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7e00, rc 0) 00000100:00100000:3.0:1762166821.776559:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+6:39134:x1847765440143744:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 146us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.776566:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 61 00000100:00100000:1.0:1762166821.777372:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.777417:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440143872 00000100:00100000:3.0:1762166821.777423:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440143872 00000100:00100000:3.0:1762166821.777454:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:3.0:1762166821.777460:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+6:39134:x1847765440143872:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166821.777632:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39134:x1847765440143872:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 171us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.777640:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 62 00000100:00100000:2.0:1762166821.778367:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.778422:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440144000 00000100:00100000:3.0:1762166821.778428:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440144000 00000100:00100000:3.0:1762166821.778460:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:3.0:1762166821.778468:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39134:x1847765440144000:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166821.778617:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39134:x1847765440144000:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 150us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.778622:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 63 00000100:00100000:2.0:1762166821.780297:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.780473:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440144128 00000100:00100000:3.0:1762166821.780508:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440144128 00000100:00100000:3.0:1762166821.780570:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:3.0:1762166821.780582:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+7:39134:x1847765440144128:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1762166821.780600:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166821.780623:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc37b7200/0x2f180c4effb0ce31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8010 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.780655:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc37b7200/0x2f180c4effb0ce31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8010 expref: 8 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.780665:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc37b7200/0x2f180c4effb0ce31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8010 expref: 8 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166821.780672:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc37b7200, rc 0) 00000100:00100000:3.0:1762166821.780757:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39134:x1847765440144128:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 180us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.780762:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 64 00000100:00100000:1.0:1762166821.781568:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.781608:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440144256 00000100:00100000:3.0:1762166821.781616:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440144256 00000100:00100000:3.0:1762166821.781658:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:3.0:1762166821.781666:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39134:x1847765440144256:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1762166821.781792:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39134:x1847765440144256:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 128us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.781817:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 65 00000100:00100000:2.0:1762166821.782412:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.782448:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440144384 00000100:00100000:3.0:1762166821.782453:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440144384 00000100:00100000:3.0:1762166821.782500:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:3.0:1762166821.782508:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39134:x1847765440144384:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1762166821.782574:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39134:x1847765440144384:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166821.782580:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 66 00000100:00100000:2.0:1762166821.784218:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166821.784418:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440144512 00000100:00100000:3.0:1762166821.784431:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440144512 00000100:00100000:2.0:1762166821.784520:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:2.0:1762166821.784531:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+8:39134:x1847765440144512:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1762166821.784554:0:32221:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166821.784572:0:32221:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc5ae5800/0x2f180c4effb0ce38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8017 expref: -99 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166821.784609:0:32221:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc5ae5800/0x2f180c4effb0ce38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8017 expref: 9 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166821.784623:0:32221:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc5ae5800/0x2f180c4effb0ce38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8017 expref: 9 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166821.784632:0:32221:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae5800, rc 0) 00000100:00100000:2.0:1762166821.784712:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39134:x1847765440144512:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 184us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166821.784720:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 67 00000100:00100000:1.0:1762166821.785879:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166821.785941:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440144640 00000100:00100000:2.0:1762166821.785949:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440144640 00000100:00100000:2.0:1762166821.785996:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00100000:2.0:1762166821.786005:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39134:x1847765440144640:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1762166821.786103:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:39134:x1847765440144640:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 100us (230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166821.786112:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 68 00000100:00080000:1.0:1762166822.162769:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166822.162792:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166822.162797:0:36:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1762166822.162806:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446858112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166822.162815:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446858240:0@lo:400:kworker.0 00000100:00080000:1.0:1762166822.162819:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff945cf35b7000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1762166822.162867:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf1ddf800 x1847765446858368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1762166822.162904:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166822.162907:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166822.162909:0:36:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166822.162917:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff945cf3704800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1762166822.162934:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf1ddd180 x1847765446858496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166822.162965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1762166822.162977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166822.162988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166822.162991:0:36:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166822.163001:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff945bccb4e000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1762166822.163039:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf3db7800 x1847765446858880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1762166822.163073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1762166822.163077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166822.163080:0:36:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1762166822.163088:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1762166822.163088:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945bc4b74800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1762166822.163111:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446858624:0@lo:400:kworker.0 00000100:00100000:1.0:1762166822.163119:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf3db6680 x1847765446859136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166822.163178:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446858240 00000100:00100000:3.0:1762166822.163190:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.163197:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446858240 00000100:00080000:1.0:1762166822.163210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1762166822.163216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1762166822.163220:0:36:0:(import.c:65:import_set_state_nolock()) ffff945cf784f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1762166822.163228:0:36:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff945cf784f000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1762166822.163242:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446859264:0@lo:400:kworker.0 00000100:00100000:1.0:1762166822.163256:0:36:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff945cf3db4e00 x1847765446859776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166822.163286:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1762166822.163296:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.163307:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765446858240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166822.163316:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446858368:0@lo:38:kworker.0 00000100:00100000:3.0:1762166822.163329:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166822.163345:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446859392:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.163401:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765446858240:12345-0@lo:400:kworker.0 Request processed in 101us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.163411:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1762166822.163459:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446859264 00000100:00100000:2.0:1762166822.163463:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446859264 00000100:00100000:2.0:1762166822.163538:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1762166822.163605:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446859264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.163641:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446859264:12345-0@lo:400:kworker.0 Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.163648:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00080000:2.0:1762166822.163669:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166822.163703:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446858752:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.163749:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.163770:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446859520:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.163815:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.163835:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1762166822.163842:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446859008:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.163860:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.163873:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446859648:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.163897:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166822.163918:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166822.163947:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446858624 00000100:00100000:3.0:1762166822.163960:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446858624 00000100:00100000:0.0:1762166822.163967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.163975:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446858752 00000100:00100000:2.0:1762166822.163982:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446858752 00000100:00100000:1.0:1762166822.163993:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446858496:0@lo:38:kworker.0 00000100:00100000:2.0:1762166822.164039:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446859520 00000100:00100000:2.0:1762166822.164049:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446859520 00000100:00100000:1.0:1762166822.164056:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166822.164070:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446859648 00000100:00100000:3.0:1762166822.164078:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446859648 00000100:00100000:0.0:1762166822.164090:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1762166822.164102:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446858880:0@lo:38:kworker.0 00000100:00100000:0.0:1762166822.164114:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446858752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.164143:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1762166822.164144:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.164158:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1762166822.164165:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446858624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166822.164185:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446859136:0@lo:38:kworker.0 00000100:00100000:2.0:1762166822.164192:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446859520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.164211:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446858752:12345-0@lo:400:kworker.0 Request processed in 107us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166822.164222:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166822.164229:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1762166822.164266:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1762166822.164270:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1847765446859776:0@lo:38:kworker.0 00000100:00100000:0.0:1762166822.164287:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3635:x1847765446859648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.164307:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446858624:12345-0@lo:400:kworker.0 Request processed in 146us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.164314:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446859520:12345-0@lo:400:kworker.0 Request processed in 140us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166822.164327:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166822.164337:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1762166822.164355:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3635:x1847765446859648:12345-0@lo:400:kworker.0 Request processed in 73us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.164357:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1762166822.164380:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1762166822.164427:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446859008 00000100:00100000:2.0:1762166822.164434:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446859008 00000100:00080000:3.0:1762166822.164440:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166822.164444:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446858368 00000100:00100000:0.0:1762166822.164449:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446858112 00000100:00080000:3.0:1762166822.164450:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166822.164451:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446858368 00000100:00100000:0.0:1762166822.164462:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446858112 00000100:00080000:3.0:1762166822.164463:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166822.164466:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446858496 00000100:00100000:2.0:1762166822.164474:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446858496 00000100:00100000:3.0:1762166822.164525:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.164546:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446858880 00000100:00100000:1.0:1762166822.164552:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1762166822.164554:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446858880 00000100:00100000:1.0:1762166822.164567:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3632:x1847765446858368:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1762166822.164581:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446859392 00000100:00100000:2.0:1762166822.164582:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446859136 00000100:00100000:2.0:1762166822.164587:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446859136 00000100:00100000:3.0:1762166822.164592:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446859264:0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.164592:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446859392 00010000:00080000:1.0:1762166822.164608:0:7427:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff945cd19e5800, cookie 0x2f180c4effb0cc6a 00000100:00100000:2.0:1762166822.164614:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446859776 00010000:00080000:1.0:1762166822.164621:0:7427:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff945cd19e5800 cur 441 last 1762166816 00000100:00100000:2.0:1762166822.164625:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446859776 00000100:00100000:3.0:1762166822.164636:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446858624:0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.164647:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1762166822.164654:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000004:00100000:1.0:1762166822.164656:0:7427:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:1.0:1762166822.164665:0:7427:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf3cb6100 00000100:00100000:0.0:1762166822.164671:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446858112:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1762166822.164674:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446859008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.164680:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765446858240:0@lo:400:kworker.0 00000004:00000024:0.0:1762166822.164714:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1762166822.164768:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446859008:12345-0@lo:400:kworker.0 Request processed in 100us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.164789:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1762166822.164831:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446859008:0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.164834:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446858112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.164846:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:3.0:1762166822.164865:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446859648:0@lo:400:kworker.0 00000100:00100000:2.0:1762166822.164867:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446858496:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1762166822.164868:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00010000:00080000:2.0:1762166822.164912:0:6494:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 441 last 0 00000100:00100000:3.0:1762166822.164919:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446858752:0@lo:400:kworker.0 00000100:00100000:0.0:1762166822.164920:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00080000:1.0:1762166822.164933:0:7427:0:(import.c:65:import_set_state_nolock()) ffff945cc4ed7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1762166822.164950:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446859392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166822.164963:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446859520:0@lo:400:kworker.0 00000020:00000080:2.0:1762166822.164967:0:6494:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2f180c4effb0ce3f 00000004:00100000:2.0:1762166822.164992:0:6494:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:2.0:1762166822.165001:0:6494:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf3cb6100 00000100:00100000:1.0:1762166822.165054:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3632:x1847765446858368:12345-0@lo:38:kworker.0 Request processed in 480us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166822.165062:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446859392:12345-0@lo:400:kworker.0 Request processed in 112us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166822.165064:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446859392:0@lo:400:kworker.0 00000100:00080000:2.0:1762166822.165064:0:6494:0:(import.c:65:import_set_state_nolock()) ffff945bc5872000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166822.165093:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1762166822.165111:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1762166822.165173:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1847765446858496:12345-0@lo:38:kworker.0 Request processed in 313us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166822.165175:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00080000:1.0:1762166822.165175:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00010000:00080000:0.0:1762166822.165179:0:32246:0:(ldlm_lib.c:2527:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1762166822.165196:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446858880:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1762166822.165198:0:32246:0:(ldlm_lib.c:2665:replay_request_or_update()) Waiting for transno 4294969036 00000100:00080000:1.0:1762166822.165205:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00100000:2.0:1762166822.165210:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000020:00080000:0.0:1762166822.165212:0:32246:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 4294969035 00010000:00080000:0.0:1762166822.165227:0:32246:0:(ldlm_lib.c:2210:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969036 00010000:00080000:3.0:1762166822.165228:0:12357:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 441 last 0 00000100:00080000:1.0:1762166822.165228:0:3632:0:(import.c:1679:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1762166822.165236:0:3632:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968889 gen 2 00010000:00080000:0.0:1762166822.165242:0:32246:0:(ldlm_lib.c:2228:check_for_next_transno()) waking for next (4294969036) 00000100:00080000:1.0:1762166822.165250:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff945cf35b7000 from lustre-MDT0000_UUID committed 4294968889 last 0 00000100:00100000:2.0:1762166822.165251:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000020:00080000:0.0:1762166822.165255:0:32246:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 4294969035 00000100:00080000:1.0:1762166822.165261:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1762166822.165271:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1847765446859136:12345-0@lo:38:kworker.0 00000020:00080000:0.0:1762166822.165286:0:32246:0:(update_records.c:54:update_records_dump()) master transno = 4294969035 batchid = 52 flags = 0 ops = 2 params = 4 00000020:00080000:0.0:1762166822.165291:0:32246:0:(update_records.c:73:update_records_dump()) update 0th [0x280000401:0x4e:0x0] xattr_set params_count = 3 00000020:00000080:3.0:1762166822.165298:0:12357:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2f180c4effb0ce46 00000020:00080000:0.0:1762166822.165298:0:32246:0:(update_records.c:88:update_records_dump()) param = ffff945cf7889064 0th off = 0 size = 12 00010000:00080000:2.0:1762166822.165299:0:6494:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 441 last 0 00000020:00080000:0.0:1762166822.165312:0:32246:0:(update_records.c:88:update_records_dump()) param = ffff945cf788907c 1th off = 1 size = 52 00000004:00100000:3.0:1762166822.165317:0:12357:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00080000:0.0:1762166822.165317:0:32246:0:(update_records.c:88:update_records_dump()) param = ffff945cf78890bc 2th off = 2 size = 4 00000020:00080000:0.0:1762166822.165321:0:32246:0:(update_records.c:73:update_records_dump()) update 1th [0x2c0000401:0x48:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1762166822.165325:0:32246:0:(update_records.c:88:update_records_dump()) param = ffff945cf7889064 0th off = 0 size = 12 00000020:00080000:0.0:1762166822.165328:0:32246:0:(update_records.c:88:update_records_dump()) param = ffff945cf78890cc 1th off = 3 size = 52 00000020:00080000:0.0:1762166822.165330:0:32246:0:(update_records.c:88:update_records_dump()) param = ffff945cf78890bc 2th off = 2 size = 4 00000020:01000000:3.0:1762166822.165340:0:12357:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf3cb6100 00000020:00000080:2.0:1762166822.165356:0:6494:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2f180c4effb0ce4d 00000004:00100000:2.0:1762166822.165375:0:6494:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1762166822.165380:0:12357:0:(import.c:65:import_set_state_nolock()) ffff945bc5677000 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1762166822.165380:0:6494:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf3cb6100 80000000:00020000:0.0:1762166822.165410:0:32246:0:(fld_handler.c:205:fld_local_lookup()) srv-lustre-MDT0000: FLD cache range [0x0000000280000400-0x00000002c0000400]:0:ost does not match requested flag 0: rc = -5 00000100:00080000:2.0:1762166822.165441:0:6494:0:(import.c:65:import_set_state_nolock()) ffff945bc5873000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166822.165467:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1847765446858880:12345-0@lo:38:kworker.0 Request processed in 270us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166822.165530:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00000100:00100000:2.0:1762166822.165557:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1847765446859136:12345-0@lo:38:kworker.0 Request processed in 285us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166822.165564:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:3.0:1762166822.165579:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1847765446859776:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1762166822.165580:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00010000:00080000:3.0:1762166822.165606:0:12357:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 441 last 0 00000100:00100000:2.0:1762166822.165629:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446858368:0@lo:38:kworker.0 00000020:00000080:3.0:1762166822.165651:0:12357:0:(genops.c:1402:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2f180c4effb0ce54 00000100:00100000:1.0:1762166822.165651:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446858112:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1762166822.165665:0:3632:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff945cf1ddd180 x1847765446858496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00100000:3.0:1762166822.165666:0:12357:0:(mdt_handler.c:7253:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:3.0:1762166822.165674:0:12357:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf3cb6100 00010000:00080000:1.0:1762166822.165694:0:32596:0:(ldlm_request.c:2714:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00000100:00080000:2.0:1762166822.165701:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1762166822.165704:0:12357:0:(import.c:65:import_set_state_nolock()) ffff945bc5675800 : changing import state from RECOVER to FULL 00010000:00010000:1.0:1762166822.165705:0:32596:0:(ldlm_request.c:2634:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1762166822.165714:0:32596:0:(ldlm_request.c:2647:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00100000:3.0:1762166822.165750:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1847765446859776:12345-0@lo:38:kworker.0 Request processed in 176us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166822.165758:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00010000:00010000:1.0:1762166822.167757:0:32596:0:(ldlm_request.c:2606:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc37b6600/0x2f180c4effafd396 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effafd39d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1762166822.167802:0:32596:0:(ldlm_request.c:2656:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00080000:2.0:1762166822.168453:0:3632:0:(import.c:1321:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff945cf1ddd180 x1847765446858496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166847 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.168462:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1762166822.168465:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf3704800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1762166822.168468:0:3632:0:(import.c:1722:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 80000000:00020000:0.0:1762166822.171375:0:32246:0:(fld_handler.c:244:fld_server_lookup()) srv-lustre-MDT0000: Cannot find sequence 0x280000401: rc = -2 00010000:00080000:1.0:1762166822.177693:0:32246:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 67 seconds 00000020:00080000:1.0:1762166822.177700:0:32246:0:(update_recovery.c:486:dtrq_destroy()) destroy x0 t4294969035 00000020:00080000:1.0:1762166822.177715:0:32246:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1762166822.177718:0:32246:0:(ldlm_lib.c:2210:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969036 00000020:00080000:1.0:1762166822.177723:0:32246:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1762166822.177725:0:32246:0:(ldlm_lib.c:2210:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969036 00000100:00100000:2.0:1762166822.179355:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1847765446858496:0@lo:38:kworker.0 00010000:00080000:2.0:1762166822.179419:0:3632:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff945cf3db7800 x1847765446858880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.179437:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1762166822.180344:0:3632:0:(import.c:1321:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff945cf3db7800 x1847765446858880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166847 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.180355:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1762166822.180361:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bccb4e000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1762166822.180365:0:3632:0:(import.c:1722:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1762166822.180371:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1847765446858880:0@lo:38:kworker.0 00010000:00080000:2.0:1762166822.180391:0:3632:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff945cf3db6680 x1847765446859136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.180403:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1762166822.181147:0:3632:0:(import.c:1321:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff945cf3db6680 x1847765446859136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166847 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.181153:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1762166822.181155:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945bc4b74800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1762166822.181172:0:3632:0:(import.c:1722:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1762166822.181175:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1847765446859136:0@lo:38:kworker.0 00010000:00080000:2.0:1762166822.181191:0:3632:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff945cf3db4e00 x1847765446859776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1762166832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.181199:0:3632:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1762166822.181202:0:3632:0:(import.c:951:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1762166822.181205:0:3632:0:(import.c:1204:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1762166822.181206:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf784f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1762166822.181209:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1847765446859776:0@lo:38:kworker.0 00000100:00100000:2.0:1762166822.181241:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446859904:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1762166822.181289:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166822.181347:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446859904 00000100:00100000:0.0:1762166822.181356:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446859904 00000100:00100000:0.0:1762166822.181412:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1762166822.181423:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1847765446859904:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1762166822.181445:0:6499:0:(ldlm_lib.c:3166:target_queue_recovery_request()) @@@ queue lock replay req req@ffff945bc5bbb100 x1847765446859904/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:608/0 lens 328/0 e 0 to 0 dl 1762166833 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166822.181464:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1847765446859904:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 43us (173us total) trans 0 rc 0/-999 00000100:00100000:0.0:1762166822.181473:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000020:00080000:1.0:1762166822.181517:0:32246:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1762166822.181523:0:32246:0:(ldlm_lib.c:2210:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969036 00010000:00080000:1.0:1762166822.181526:0:32246:0:(ldlm_lib.c:2244:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1762166822.181529:0:32246:0:(update_recovery.c:587:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1762166822.181536:0:32246:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1762166822.181539:0:32246:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1762166822.181549:0:32246:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.204.38@tcp: req@ffff945bc5bb9880 x1847765440143104/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:606/0 lens 328/0 e 0 to 0 dl 1762166831 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1762166822.181567:0:32246:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166822.181602:0:32246:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0ce5b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c9e expref: -99 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181630:0:32246:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0ce5b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c9e expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181647:0:32246:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0ce5b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c9e expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181656:0:32246:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15a00, rc 0) 00010000:00080000:1.0:1762166822.181714:0:32246:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:1.0:1762166822.181726:0:32246:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1762166822.181729:0:32246:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1762166822.181735:0:32246:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.204.38@tcp: req@ffff945bc406d880 x1847765440142848/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:606/0 lens 328/0 e 0 to 0 dl 1762166831 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1762166822.181746:0:32246:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166822.181759:0:32246:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0ce62 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7f84 expref: -99 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181787:0:32246:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0ce62 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f84 expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181798:0:32246:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0ce62 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f84 expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181807:0:32246:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14200, rc 0) 00010000:00080000:1.0:1762166822.181830:0:32246:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1762166822.181842:0:32246:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1762166822.181844:0:32246:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1762166822.181852:0:32246:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.204.38@tcp: req@ffff945bc5bb8e00 x1847765440142976/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:606/0 lens 328/0 e 0 to 0 dl 1762166831 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1762166822.181870:0:32246:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166822.181881:0:32246:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0ce69 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7d2a expref: -99 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181895:0:32246:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0ce69 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d2a expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181903:0:32246:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0ce69 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d2a expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181910:0:32246:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15600, rc 0) 00010000:00080000:1.0:1762166822.181939:0:32246:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1762166822.181947:0:32246:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1762166822.181949:0:32246:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1762166822.181956:0:32246:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 192.168.204.38@tcp: req@ffff945bc5bbb480 x1847765440143232/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:606/0 lens 328/0 e 0 to 0 dl 1762166831 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1762166822.181967:0:32246:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166822.181979:0:32246:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0ce70 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7c2e expref: -99 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.181993:0:32246:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0ce70 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c2e expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.182004:0:32246:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0ce70 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c2e expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.182012:0:32246:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14e00, rc 0) 00010000:00080000:1.0:1762166822.182037:0:32246:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1762166822.182050:0:32246:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1762166822.182052:0:32246:0:(ldlm_lib.c:2264:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1762166822.182057:0:32246:0:(ldlm_lib.c:2867:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff945bc5bbb100 x1847765446859904/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:608/0 lens 328/0 e 0 to 0 dl 1762166833 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1762166822.182068:0:32246:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166822.182079:0:32246:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0ce77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effafd396 expref: -99 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.182094:0:32246:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0ce77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effafd396 expref: 7 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.182103:0:32246:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15200/0x2f180c4effb0ce77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effafd396 expref: 7 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.182110:0:32246:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15200, rc 0) 00010000:00080000:1.0:1762166822.182145:0:32246:0:(ldlm_lib.c:2082:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1762166822.182153:0:32246:0:(ldlm_lib.c:2434:target_next_replay_lock()) Waiting for lock 00010000:00010000:2.0:1762166822.182186:0:3632:0:(ldlm_request.c:2523:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc37b6600/0x2f180c4effafd396 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0ce77 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1762166822.182196:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1762166822.182219:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446859904:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1762166822.182234:0:3632:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446860032:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1762166822.182259:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166822.182301:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446860032 00000100:00100000:0.0:1762166822.182313:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446860032 00000100:00100000:0.0:1762166822.182341:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1762166822.182347:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3632:x1847765446860032:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1762166822.182358:0:6499:0:(ldlm_lib.c:3116:target_queue_recovery_request()) @@@ queue final req req@ffff945bc5ef6300 x1847765446860032/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:608/0 lens 224/0 e 0 to 0 dl 1762166833 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166822.182378:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3632:x1847765446860032:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 31us (120us total) trans 0 rc 0/-999 00000100:00100000:0.0:1762166822.182384:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1762166822.183192:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166822.183254:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440144768 00000100:00100000:3.0:1762166822.183264:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440144768 00000100:00100000:3.0:1762166822.183322:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 441 00000100:00100000:3.0:1762166822.183332:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:2415:x1847765440144768:12345-192.168.204.38@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1762166822.183352:0:6495:0:(ldlm_lib.c:3116:target_queue_recovery_request()) @@@ queue final req req@ffff945bc4011f80 x1847765440144768/t0(0) o400->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:608/0 lens 224/0 e 0 to 0 dl 1762166833 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1762166822.183375:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:2415:x1847765440144768:12345-192.168.204.38@tcp:400:ptlrpcd_rcv.0 Request processed in 46us (190us total) trans 0 rc 0/-999 00000100:00100000:3.0:1762166822.183383:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 441 00010000:00080000:1.0:1762166822.183405:0:32246:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1762166822.183560:0:32246:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00100000:3.0:1762166822.184856:0:32215:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1e11365-ba0b-405b-99c9-a704373217f2 00000001:00100000:3.0:1762166822.184865:0:32215:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1762166822.185738:0:32246:0:(tgt_lastrcvd.c:187:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1762166822.185802:0:32246:0:(ldlm_lib.c:1980:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1762166822.185817:0:32246:0:(ldlm_lib.c:2919:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff945bc5ef6300 x1847765446860032/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:608/0 lens 224/0 e 0 to 0 dl 1762166833 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1762166822.185960:0:32246:0:(ldlm_lib.c:2919:target_recovery_thread()) @@@ processing final ping from 192.168.204.38@tcp: req@ffff945bc4011f80 x1847765440144768/t0(0) o400->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:608/0 lens 224/0 e 0 to 0 dl 1762166833 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.185983:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1762166822.185997:0:3632:0:(client.c:3193:ptlrpc_resend_req()) @@@ going to resend req@ffff945bc5bba300 x1847765446860032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1762166838 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.186008:0:3632:0:(client.c:3202:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff945bc5bba300 x1847765446860032/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1762166838 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1762166822.186015:0:3632:0:(import.c:65:import_set_state_nolock()) ffff945cf35b7000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00010000:02000000:1.0:1762166822.186042:0:32246:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00000100:02000000:2.0:1762166822.186058:0:3632:0:(import.c:1722:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1762166822.186066:0:3632:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1847765446860032:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1762166822.186205:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446860160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1762166822.186254:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166822.186310:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446860160 00000100:00100000:0.0:1762166822.186317:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446860160 00000100:00100000:0.0:1762166822.186364:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1762166822.186373:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446860160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1762166822.186409:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445994496 avail 1299755008 00000100:00100000:0.0:1762166822.186457:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446860160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166822.186465:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1762166822.186516:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446860160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166822.187349:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166822.187403:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440143360 00000100:00100000:0.0:1762166822.187408:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440143360 00000100:00100000:0.0:1762166822.187440:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2906 00000100:00100000:0.0:1762166822.187445:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:48222:x1847765440143360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166822.187455:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166822.187512:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1e00/0x2f180c4effb0ce7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b7ffb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.187559:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166822.187579:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166822.187587:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166822.187626:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166822.187629:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166822.187644:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166822.187661:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1e00/0x2f180c4effb0ce7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.187672:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 11 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.187678:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166822.187680:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166822.187682:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1600, rc 0) 00000100:00100000:0.0:1762166822.187723:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:48222:x1847765440143360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 277us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166822.187730:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2906 00000100:00100000:3.0:1762166822.189715:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166822.189761:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440144896 00000100:00100000:0.0:1762166822.189767:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440144896 00000100:00100000:0.0:1762166822.189815:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2907 00000100:00100000:0.0:1762166822.189825:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:48222:x1847765440144896:12345-192.168.204.38@tcp:41:lfs.0 00000004:00000024:0.0:1762166822.189850:0:6495:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445994496 avail 1299755008 00000100:00100000:0.0:1762166822.189892:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:48222:x1847765440144896:12345-192.168.204.38@tcp:41:lfs.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166822.189905:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2907 00000100:00100000:2.0:1762166822.191106:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166822.191145:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440145024 00000100:00100000:0.0:1762166822.191150:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440145024 00000100:00100000:0.0:1762166822.191197:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2908 00000100:00100000:0.0:1762166822.191205:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:48222:x1847765440145024:12345-192.168.204.38@tcp:41:lfs.0 00000100:00080000:3.0:1762166822.191215:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1762166822.191222:0:6495:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1762166822.191259:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:48222:x1847765440145024:12345-192.168.204.38@tcp:41:lfs.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166822.191266:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2908 00000100:00100000:3.0:1762166822.192743:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166822.192861:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440145152 00000100:00100000:2.0:1762166822.192868:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440145152 00000100:00100000:2.0:1762166822.192939:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 226 00000100:00080000:3.0:1762166822.192944:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166822.192953:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1e11365-ba0b-405b-99c9-a704373217f2+10:48222:x1847765440145152:12345-192.168.204.38@tcp:13:lfs.0 00002000:00000024:2.0:1762166822.192986:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51822272 pending 0 free 3921379328 avail 3689857024 00000100:00100000:2.0:1762166822.193040:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1e11365-ba0b-405b-99c9-a704373217f2+10:48222:x1847765440145152:12345-192.168.204.38@tcp:13:lfs.0 Request processed in 93us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.193050:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 226 00000100:00100000:3.0:1762166822.194239:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166822.194289:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440145280 00000100:00100000:2.0:1762166822.194296:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440145280 00000100:00100000:2.0:1762166822.194349:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 227 00000100:00080000:3.0:1762166822.194351:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166822.194358:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1e11365-ba0b-405b-99c9-a704373217f2+8:48222:x1847765440145280:12345-192.168.204.38@tcp:13:lfs.0 00002000:00000024:2.0:1762166822.194382:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43441856 pending 0 free 3922440192 avail 3690917888 00000100:00100000:2.0:1762166822.194439:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1e11365-ba0b-405b-99c9-a704373217f2+8:48222:x1847765440145280:12345-192.168.204.38@tcp:13:lfs.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.194448:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 227 00000004:00000080:1.0:1762166822.208261:0:32246:0:(mdd_device.c:2257:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa82787e67e10 00100000:10000000:1.0:1762166822.208276:0:32246:0:(lfsck_lib.c:3080:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1762166822.208657:0:32232:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x4e:0x0] 00000004:00080000:3.0:1762166822.208681:0:32234:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x48:0x0] 00000100:00100000:0.0:1762166822.208710:0:32232:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32232:1847765446860288:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1762166822.208723:0:32234:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32234:1847765446860416:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1762166822.208797:0:32234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.208874:0:32232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166822.208880:0:32234:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166822.208885:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446860416 00000100:00100000:0.0:1762166822.208894:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446860416 00000100:00100000:3.0:1762166822.208908:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446860288 00000100:00100000:3.0:1762166822.208913:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446860288 00000100:00100000:2.0:1762166822.208918:0:32232:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166822.208947:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1762166822.208955:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1762166822.208959:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:32234:x1847765446860416:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1762166822.208970:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:32232:x1847765446860288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1762166822.208987:0:8380:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -25 00002000:00080000:3.0:1762166822.208989:0:8382:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -19 00002000:02000040:0.0:1762166822.208994:0:8380:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:73 to 0x2c0000401:97) 00002000:02000040:3.0:1762166822.208995:0:8382:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:97) 00002000:00010000:3.0:1762166822.209041:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.209051:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209064:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209067:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209072:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209088:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209098:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209113:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209134:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.209154:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.209168:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209175:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.209178:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209185:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209198:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209203:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6000/0x2f180c4effb0ce8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209221:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.209223:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.209226:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166822.209307:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.209313:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209320:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209322:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209325:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209333:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209339:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209344:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209363:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.209386:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.209393:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209401:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b7000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.209405:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209413:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209429:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.209431:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.209440:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc37b7000/0x2f180c4effb0ce93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209442:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209456:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.209458:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.209460:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.209469:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209471:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209474:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209521:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209529:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209536:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209551:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.209566:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.209574:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209581:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc37b6400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.209585:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209592:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209603:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209609:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc37b6400/0x2f180c4effb0ce9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.209615:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.209621:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209623:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.209629:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209632:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166822.209632:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.209636:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.209637:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209645:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209650:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209659:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209672:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.209680:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.209685:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209701:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fda00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.209705:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209716:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.209726:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.209728:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209736:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209739:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fda00/0x2f180c4effb0cea1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209750:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209754:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209757:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209760:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.209764:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.209767:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.209769:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209789:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209796:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209812:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.209829:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.209841:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.209848:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fc200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.209852:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.209860:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.209873:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.209879:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc200/0x2f180c4effb0cea8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.209882:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.209890:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.209895:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.209897:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.209898:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.209908:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209909:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.209911:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209917:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209922:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209926:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.209938:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.209959:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.209964:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.209972:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fd800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.209976:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.209985:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.209991:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210004:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166822.210004:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210006:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210010:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210019:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210021:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210029:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd800/0x2f180c4effb0ceaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210039:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210045:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210047:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210049:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210057:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210072:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.210076:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.210080:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210087:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fdc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.210091:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210097:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210108:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210114:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fdc00/0x2f180c4effb0ceb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210135:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166822.210139:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.210139:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210141:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210147:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210155:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210156:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210159:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210167:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210175:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210181:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210195:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.210202:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.210207:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210214:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fd000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.210218:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210226:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210237:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210244:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd000/0x2f180c4effb0cebd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210259:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210262:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210263:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166822.210265:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.210271:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210288:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210289:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210292:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210300:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210305:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210309:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210319:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.210328:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.210334:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210351:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fce00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.210355:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210362:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.210365:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.210372:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210376:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210377:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210380:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210383:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210391:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fce00/0x2f180c4effb0cec4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210395:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210409:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210419:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210421:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210425:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.210429:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210435:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1762166822.210436:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fd400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.210445:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210453:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.210457:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210468:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.210508:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.210508:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fd400/0x2f180c4effb0cecb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210514:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210522:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210524:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210526:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210530:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210532:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210534:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210537:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210540:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210545:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210554:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.210563:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.210568:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210576:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fde00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.210580:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210586:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.210598:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.210598:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210606:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210610:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fde00/0x2f180c4effb0ced2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210625:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210630:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166822.210630:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210634:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166822.210634:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210639:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210649:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210655:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210661:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210675:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.210681:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.210692:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210699:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fcc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.210702:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210710:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210721:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210728:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fcc00/0x2f180c4effb0ced9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.210748:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.210755:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210756:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210759:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210763:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210767:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210769:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210784:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210794:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210802:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210811:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210821:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.210831:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.210836:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210844:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.210848:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210855:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.210875:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.210876:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210880:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210892:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0cee0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210893:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210896:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.210899:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210911:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210913:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.210914:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.210917:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.210925:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210932:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.210952:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.210977:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.210984:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.210994:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.210997:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211006:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.211009:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.211014:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211036:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211050:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211053:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211058:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211060:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0cee7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211080:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211091:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211092:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.211096:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.211099:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.211102:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211129:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1762166822.211187:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.211192:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211199:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211201:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211204:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211213:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211220:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211232:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211235:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.211239:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211246:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.211250:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211251:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.211257:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211272:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.211273:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211280:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211285:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0ceee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211296:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.211306:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.211308:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211317:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211321:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.211325:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1762166822.211337:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166822.211338:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211348:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211352:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0cef5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211360:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211364:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211368:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211378:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.211380:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211387:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211397:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.211398:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211401:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.211419:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.211435:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.211440:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211448:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.211451:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211460:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211471:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.211504:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.211504:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0cefc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211510:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211519:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.211521:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.211523:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.211528:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211530:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211534:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211542:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211549:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211556:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211572:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.211590:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.211594:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211601:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.211605:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166822.211637:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.211637:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211642:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211648:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211649:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211650:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166822.211654:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211655:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0cf03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211662:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211667:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.211669:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.211670:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.211671:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.211683:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.211704:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1762166822.211757:0:8382:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:78 00010000:00010000:1.0:1762166822.211770:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.211788:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211796:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.211800:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211808:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211829:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211836:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0cf0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.211859:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.211860:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.211864:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166822.211865:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:32232:x1847765446860288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2893us (2988us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166822.211879:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1762166822.212054:0:32232:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32232:1847765446860288:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1762166822.212069:0:32232:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x61:0x0] from OST, last_created [0x280000401:0x61:0x0]last_used is [0x280000401:0x4e:0x0] 00000100:00100000:2.0:1762166822.212146:0:32232:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32232:1847765446860672:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1762166822.212152:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446860544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166822.212189:0:32232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166822.212195:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166822.212236:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446860672 00000100:00100000:2.0:1762166822.212237:0:32232:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166822.212245:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446860672 00000100:00100000:2.0:1762166822.212259:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446860544 00000100:00100000:2.0:1762166822.212264:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446860544 00000100:00100000:1.0:1762166822.212293:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1762166822.212309:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1762166822.212311:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:32232:x1847765446860672:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1762166822.212323:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446860544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1762166822.212342:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51822272 pending 0 free 3921379328 avail 3689857024 00002000:00080000:1.0:1762166822.212363:0:8382:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 98 00000100:00100000:2.0:1762166822.212383:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446860544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.212391:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1762166822.212416:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446860544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166822.214666:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:32232:x1847765446860672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2351us (2468us total) trans 21474836711 rc 0/0 00000100:00100000:1.0:1762166822.214686:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1762166822.214693:0:32232:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32232:1847765446860672:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1762166822.214710:0:32232:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x61:0x0]-[0x280000401:0x81:0x0] 00002000:00010000:0.0:1762166822.217146:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.217157:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217174:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.217176:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.217183:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217219:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217229:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217237:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217262:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.217300:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.217317:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.217343:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.217349:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.217364:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.217395:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.217403:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0cf11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.217438:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.217443:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.217446:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166822.217521:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.217529:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217539:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.217541:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.217546:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217557:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217568:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217575:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.217606:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.217638:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.217647:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.217657:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.217661:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.217670:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.217705:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.217712:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0cf18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.217731:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.217733:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.217734:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166822.218412:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.218421:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218431:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.218432:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.218436:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218448:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218456:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218463:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218527:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166822.218635:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166822.218649:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.218664:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166822.218670:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.218682:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.218695:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.218705:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.218711:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218717:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.218723:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.218732:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218791:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218803:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218811:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.218888:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.218918:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166822.220201:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1c00/0x2f180c4effb0cf1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220203:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.220210:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.220233:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220242:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.220253:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220256:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.220261:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.220267:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220292:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220300:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.220302:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.220308:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.220310:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.220314:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.220320:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220326:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0cf26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220349:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220363:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.220367:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.220369:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.220408:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.220455:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.220463:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.220470:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.220474:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.220522:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.220535:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.220540:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0cf2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.220553:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.220558:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.220560:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166822.220631:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.220638:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220647:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.220648:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.220651:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220661:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220669:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220677:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220699:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.220719:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.220727:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220736:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.220739:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220747:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220762:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220769:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0cf34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.220814:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.220817:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166822.220819:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.220822:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.220828:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220838:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.220840:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.220843:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220866:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220874:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.220882:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166822.220887:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869389 is committed 00010000:00010000:0.0:1762166822.220921:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.220989:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.221001:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.221005:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.221010:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221011:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.221015:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221016:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221018:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221021:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221024:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221030:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221036:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221039:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221044:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221048:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0cf3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221072:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.221087:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.221091:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221100:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166822.221102:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.221105:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221116:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221126:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221133:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0cf42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221145:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166822.221145:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166822.221147:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.221149:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.221150:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221157:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221158:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221161:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221170:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221178:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221186:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221204:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.221243:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.221253:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.221263:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.221267:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.221276:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.221290:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.221295:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.221299:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0cf49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221304:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221325:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221327:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221331:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.221336:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.221340:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.221345:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.221358:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221367:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221373:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221394:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.221424:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.221431:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221441:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.221445:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221465:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.221473:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.221512:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221514:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221531:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221533:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221536:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221549:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0cf50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221554:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221566:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221574:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221601:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.221606:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221613:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1762166822.221614:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.221619:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221628:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221639:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221647:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1800/0x2f180c4effb0cf57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221680:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.221684:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.221686:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166822.221701:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.221708:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221716:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221718:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.221721:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221729:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221735:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221743:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221770:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.221851:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1762166822.221861:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166822.221868:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221871:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221918:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166822.221920:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cbc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166822.221923:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166822.221929:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221931:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.221941:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.221977:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.221981:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.221995:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222026:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222032:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222045:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0cf5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222061:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.222067:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.222074:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222081:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.222085:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.222102:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.222121:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222145:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222153:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0cf65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.222164:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.222171:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222180:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.222180:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.222183:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166822.222190:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.222190:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222201:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.222208:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222216:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222222:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222246:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.222270:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.222278:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.222303:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29caa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.222309:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.222311:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166822.222322:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222323:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222346:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.222348:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166822.222350:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222352:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.222373:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0cf6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222376:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222393:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.222398:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.222401:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.222402:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.222406:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.222426:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.222456:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.222466:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222524:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.222530:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222541:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.222557:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.222564:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222569:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222573:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.222579:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.222585:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222624:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0cf73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222637:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222651:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222689:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222712:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.222723:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.222732:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222742:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.222746:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222756:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222791:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222801:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0cf7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.222802:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166822.222814:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.222818:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222861:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.222864:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.222867:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.222872:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.222879:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.222886:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.222893:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222904:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222911:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.222945:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.222976:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.222984:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.222994:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.222999:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223008:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.223025:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.223032:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223035:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223042:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223046:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166822.223048:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0cf81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223051:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223062:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223076:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223081:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223085:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.223089:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.223104:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.223107:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.223112:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223127:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.223131:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223137:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.223141:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223153:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223162:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0cf88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223177:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.223179:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.223188:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166822.223301:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.223307:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223316:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223317:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223319:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223339:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223347:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223354:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223372:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.223390:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.223396:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223405:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.223409:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223417:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.223421:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.223427:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223430:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223434:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223436:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223440:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223447:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca400/0x2f180c4effb0cf8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223452:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223466:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223471:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.223473:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.223496:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.223500:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.223535:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166822.223552:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166822.223559:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.223568:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166822.223571:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.223579:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.223592:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.223599:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0cf96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.223604:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.223608:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223618:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223619:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223623:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.223626:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.223628:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166822.223630:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.223632:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223639:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223647:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223664:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.223684:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.223692:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223702:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.223706:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223720:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223733:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.223734:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.223745:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223746:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0cf9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223763:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223767:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223770:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223786:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.223789:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.223792:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166822.223804:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223811:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223815:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223826:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166822.223892:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1762166822.223897:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166822.223898:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223907:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223911:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.223917:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223920:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223922:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.223927:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223929:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223950:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223954:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223959:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223971:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0cfa4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.223973:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.223997:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166822.224002:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.224009:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166822.224012:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224013:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1762166822.224025:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.224037:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166822.224044:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0cfab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224058:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.224074:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.224082:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166822.224084:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762166822.224107:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.224113:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224122:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.224123:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.224126:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224134:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224141:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224148:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224172:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166822.224207:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.224213:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224221:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.224225:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166822.224237:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166822.224245:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224248:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224256:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.224259:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166822.224263:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224268:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224289:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0cfb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224291:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224307:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224312:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224314:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.224319:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166822.224323:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166822.224328:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1762166822.224332:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166822.224336:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224344:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166822.224348:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.224357:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224364:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf786a400/0x2f180c4effb0cfb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166822.224392:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.224394:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166822.224396:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1762166822.224401:0:8380:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:72 00000100:00100000:0.0:1762166822.225715:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:32234:x1847765446860416:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16751us (16912us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166822.225730:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1762166822.225759:0:32234:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869389 gen 2 00000004:00080000:3.0:1762166822.225770:0:32234:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dded80, transno 17179869389 00000100:00100000:3.0:1762166822.225803:0:32234:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32234:1847765446860416:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1762166822.225824:0:32234:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x61:0x0] from OST, last_created [0x2c0000401:0x61:0x0]last_used is [0x2c0000401:0x48:0x0] 00000100:00100000:3.0:1762166822.225948:0:32234:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32234:1847765446860928:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1762166822.225969:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166822.225992:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446860800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166822.226021:0:32234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762166822.226028:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000004:00080000:2.0:1762166822.226072:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000100:00100000:0.0:1762166822.226114:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1762166822.226133:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762166822.226135:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446861056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166822.226179:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.226188:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446861184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166822.226297:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166822.227056:0:32234:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166822.227086:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446860928 00000100:00100000:0.0:1762166822.227097:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446860928 00000100:00100000:2.0:1762166822.227103:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446861056 00000100:00100000:2.0:1762166822.227116:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446861056 00000100:00100000:3.0:1762166822.227137:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446861184 00000100:00100000:3.0:1762166822.227145:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446861184 00000100:00100000:0.0:1762166822.227188:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1762166822.227189:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166822.227213:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1762166822.227214:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:32234:x1847765446860928:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1762166822.227234:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1762166822.227246:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3635:x1847765446861056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166822.227252:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446861184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166822.227282:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446860800 00000100:00100000:1.0:1762166822.227291:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446860800 00002000:00080000:0.0:1762166822.227292:0:8380:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 98 00000100:00100000:1.0:1762166822.227334:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1762166822.227353:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446860800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166822.227390:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43441856 pending 896 free 3922440192 avail 3690917888 00000100:00100000:2.0:1762166822.227463:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3635:x1847765446861056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (1284us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166822.227463:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3636:x1847765446860800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166822.227525:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1762166822.227561:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446861184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 313us (1263us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166822.227578:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000004:00080000:2.0:1762166822.227676:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef4380, transno 0 00000004:00080000:2.0:1762166822.227687:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef4380/1, rc -22, transno 0 00000004:00080000:3.0:1762166822.227695:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5ef5c00, transno 0 00000004:00080000:3.0:1762166822.227706:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5ef5c00/1, rc -22, transno 0 00000100:00100000:2.0:1762166822.227717:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446861184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166822.227725:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446861056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166822.227880:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446860800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166822.227888:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1762166822.231119:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:32234:x1847765446860928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3908us (5092us total) trans 17179869390 rc 0/0 00000100:00100000:0.0:1762166822.231133:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1762166822.231215:0:32234:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32234:1847765446860928:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1762166822.231254:0:32234:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x61:0x0]-[0x2c0000401:0x81:0x0] 00000001:00080000:3.0:1762166822.676819:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967474 is committed 00010000:00010000:1.0:1762166822.738587:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1762166823.293841:0:32682:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:1.0:1762166823.698721:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446861312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166823.698818:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166823.698896:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446861312 00000100:00100000:0.0:1762166823.698908:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446861312 00000100:00100000:0.0:1762166823.698990:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1762166823.699009:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446861312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1762166823.699043:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51821376 pending 0 free 3921379328 avail 3689857024 00000100:00100000:0.0:1762166823.699140:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446861312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166823.699153:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1762166823.699202:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446861312:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1762166823.762647:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1762166823.848020:0:32730:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1762166824.786627:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166825.141409:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166825.141500:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440145408 00000100:00100000:3.0:1762166825.141510:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440145408 00000100:00080000:2.0:1762166825.141578:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166825.141591:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2909 00000100:00100000:3.0:1762166825.141603:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:48672:x1847765440145408:12345-192.168.204.38@tcp:41:lfs.0 00000004:00000024:3.0:1762166825.141642:0:6495:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445994496 avail 1299755008 00000100:00100000:3.0:1762166825.141729:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:48672:x1847765440145408:12345-192.168.204.38@tcp:41:lfs.0 Request processed in 118us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166825.141740:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2909 00000100:00100000:3.0:1762166825.142740:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.142796:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440145536 00000100:00100000:0.0:1762166825.142803:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440145536 00000100:00080000:2.0:1762166825.142847:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166825.142862:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2910 00000100:00100000:0.0:1762166825.142873:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:48672:x1847765440145536:12345-192.168.204.38@tcp:41:lfs.0 00000004:00000024:0.0:1762166825.142894:0:6495:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1762166825.142947:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:48672:x1847765440145536:12345-192.168.204.38@tcp:41:lfs.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.142955:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2910 00000100:00100000:2.0:1762166825.144144:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.144197:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440145664 00000100:00100000:0.0:1762166825.144201:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440145664 00000100:00100000:0.0:1762166825.144235:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 231 00000100:00100000:0.0:1762166825.144243:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1e11365-ba0b-405b-99c9-a704373217f2+10:48672:x1847765440145664:12345-192.168.204.38@tcp:13:lfs.0 00000100:00080000:2.0:1762166825.144244:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1762166825.144266:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51821376 pending 0 free 3921379328 avail 3689857024 00000100:00100000:0.0:1762166825.144306:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1e11365-ba0b-405b-99c9-a704373217f2+10:48672:x1847765440145664:12345-192.168.204.38@tcp:13:lfs.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.144314:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 231 00000100:00100000:2.0:1762166825.145068:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.145115:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440145792 00000100:00100000:0.0:1762166825.145132:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440145792 00000100:00080000:2.0:1762166825.145174:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166825.145174:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:0.0:1762166825.145187:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1e11365-ba0b-405b-99c9-a704373217f2+8:48672:x1847765440145792:12345-192.168.204.38@tcp:13:lfs.0 00002000:00000024:0.0:1762166825.145208:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3922440192 avail 3690917888 00000100:00100000:0.0:1762166825.145247:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1e11365-ba0b-405b-99c9-a704373217f2+8:48672:x1847765440145792:12345-192.168.204.38@tcp:13:lfs.0 Request processed in 64us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.145256:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 232 00000100:00100000:3.0:1762166825.161742:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.161848:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440145920 00000100:00100000:0.0:1762166825.161860:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440145920 00000100:00100000:0.0:1762166825.161929:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2911 00000100:00100000:0.0:1762166825.161941:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:48689:x1847765440145920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.161962:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.161984:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0cfc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b801e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.162042:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162053:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162062:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162072:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162078:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162084:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162267:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0cfd5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162275:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0cfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162281:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0cfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.162307:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1762166825.162319:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166825.162344:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0cfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162356:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162362:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162368:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162374:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162380:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.162384:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162389:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162398:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166825.162405:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.162409:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162413:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0cfc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162423:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162426:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162430:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162433:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786bc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.162434:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162437:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162441:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff945bc4077a00) 00010000:00010000:0.0:1762166825.162442:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.162444:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162447:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.162467:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0cfc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b801e expref: 13 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.162523:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0cfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b801e expref: 12 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.162528:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077700) 00010000:00010000:0.0:1762166825.162530:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166825.162531:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b800, rc 0) 00000100:00100000:0.0:1762166825.162573:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:48689:x1847765440145920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 636us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.162579:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2911 00000100:00100000:2.0:1762166825.164931:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.165013:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440146176 00000100:00100000:0.0:1762166825.165020:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440146176 00000100:00100000:0.0:1762166825.165062:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2912 00000100:00100000:0.0:1762166825.165070:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:48689:x1847765440146176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.165084:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.165098:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0cfdc lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8025 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.165153:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165164:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165172:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165218:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165235:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165241:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165672:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165693:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165706:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.165716:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:0.0:1762166825.165814:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165822:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165828:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165835:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165840:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.165844:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165852:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165872:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077700) 00010000:00010000:0.0:1762166825.165875:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.165879:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165885:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0cfe3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165897:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165902:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165908:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165912:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.165915:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165920:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165940:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945bc4077600) 00010000:00010000:0.0:1762166825.165943:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.165946:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165952:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0cfea lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.165987:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0cfdc lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.166009:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.166016:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077b00) 00010000:00010000:0.0:1762166825.166019:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166825.166021:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a800, rc 0) 00000100:00100000:0.0:1762166825.166071:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:48689:x1847765440146176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1001us (1143us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1762166825.166080:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2912 00000100:00100000:2.0:1762166825.168131:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.168182:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440146432 00000100:00100000:0.0:1762166825.168189:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440146432 00000100:00100000:0.0:1762166825.168233:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 834 00000100:00100000:0.0:1762166825.168242:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:48689:x1847765440146432:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166825.168400:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:48689:x1847765440146432:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 159us (271us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1762166825.168409:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 834 00000100:00100000:3.0:1762166825.170060:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.170130:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440146688 00000100:00100000:0.0:1762166825.170141:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440146688 00000100:00100000:0.0:1762166825.170219:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2913 00000100:00100000:0.0:1762166825.170231:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:48689:x1847765440146688:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.170261:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.170286:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfff lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b802c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.170414:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d006 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.170447:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d006 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.170459:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d006 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.170473:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:0.0:1762166825.170617:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0cfff lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b802c expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.170638:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d006 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b802c expref: 17 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.170648:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077b00) 00010000:00010000:0.0:1762166825.170651:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166825.170655:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:0.0:1762166825.170747:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:48689:x1847765440146688:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 518us (697us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1762166825.170756:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2913 00000100:00100000:2.0:1762166825.173238:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.173312:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440146944 00000100:00100000:0.0:1762166825.173325:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440146944 00000100:00100000:0.0:1762166825.173393:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2914 00000100:00100000:0.0:1762166825.173405:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:48689:x1847765440146944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.173434:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.173458:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d014 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8033 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.173625:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 3/0,1 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.173658:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.173667:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 4/0,1 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.173707:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.173737:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 18 pid: 6495 timeout: 544 lvb_type: 0 00000100:00100000:0.0:1762166825.173754:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446861440:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166825.173876:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166825.175045:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446861440:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166825.175068:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 3/0,1 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166825.175369:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166825.175465:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440147072 00000100:00100000:1.0:1762166825.175521:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440147072 00010000:00010000:1.0:1762166825.175561:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 19 pid: 6495 timeout: 544 lvb_type: 0 00000100:00100000:1.0:1762166825.175595:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 690 00000100:00100000:1.0:1762166825.175604:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440147072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166825.175619:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166825.175626:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 19 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.175640:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 19 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.175663:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0cff1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8025 expref: 19 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.175697:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077b00) 00010000:00010000:1.0:1762166825.175702:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 3/0,1 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166825.175712:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166825.175735:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166825.175771:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166825.175808:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166825.175818:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166825.175833:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440147072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 229us (472us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166825.175838:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000100:00100000:1.0:1762166825.175844:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 690 00010000:00010000:3.0:1762166825.175977:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d014 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8033 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.175995:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8033 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.176002:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077b00) 00010000:00010000:3.0:1762166825.176005:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166825.176013:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ac00, rc 0) 00000100:00100000:3.0:1762166825.176038:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:48689:x1847765440146944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2636us (2812us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1762166825.176045:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2914 00000100:00100000:2.0:1762166825.177620:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.177682:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440147200 00000100:00100000:0.0:1762166825.177701:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440147200 00000100:00100000:0.0:1762166825.177760:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 835 00000100:00100000:0.0:1762166825.177769:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:48689:x1847765440147200:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166825.177885:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:48689:x1847765440147200:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 118us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.177892:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 835 00000100:00100000:2.0:1762166825.178938:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.178982:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440147456 00000100:00100000:0.0:1762166825.178988:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440147456 00000100:00100000:0.0:1762166825.179031:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 836 00000100:00100000:0.0:1762166825.179040:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:48689:x1847765440147456:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166825.179170:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:48689:x1847765440147456:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 131us (234us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1762166825.179179:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 836 00000100:00100000:2.0:1762166825.180159:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166825.180217:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440147712 00000100:00100000:3.0:1762166825.180229:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440147712 00000100:00100000:3.0:1762166825.180295:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2915 00000100:00100000:3.0:1762166825.180307:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:48689:x1847765440147712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166825.180333:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166825.180338:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166825.180374:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d01b lrc: 0/0,0 mode: --/CW res: [0x200000405:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8033 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.180399:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d006 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b802c expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.180410:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077b00) 00010000:00010000:3.0:1762166825.180422:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166825.180443:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d029 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b803a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.180592:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0d030 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166825.180607:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0d030 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166825.180617:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0d030 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166825.180628:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:3.0:1762166825.180756:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d029 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b803a expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.180771:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0d030 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b803a expref: 19 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.180778:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd1dddc00) 00010000:00010000:3.0:1762166825.180782:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166825.180784:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28200, rc 0) 00000100:00100000:3.0:1762166825.180847:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:48689:x1847765440147712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 543us (688us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1762166825.180855:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2915 00000100:00100000:2.0:1762166825.182069:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.182112:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440147968 00000100:00100000:0.0:1762166825.182118:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440147968 00000100:00100000:0.0:1762166825.182157:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 837 00000100:00100000:0.0:1762166825.182166:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:48689:x1847765440147968:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166825.182213:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0xf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0d030 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b803a expref: 19 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.182249:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182260:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182269:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182391:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182399:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182406:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182412:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.182426:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182434:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182444:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd1dddc00) 00010000:00010000:0.0:1762166825.182447:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166825.182451:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182457:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d03e lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.182469:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd1dddc00) 00010000:00010000:0.0:1762166825.182471:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166825.182521:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0d030 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b803a expref: 19 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166825.182658:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:48689:x1847765440147968:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 493us (592us total) trans 8589934599 rc -22/-22 00000100:00100000:0.0:1762166825.182667:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 837 00000100:00100000:2.0:1762166825.188259:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166825.188317:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440148096 00000100:00100000:3.0:1762166825.188332:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440148096 00000100:00100000:3.0:1762166825.188370:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2916 00000100:00100000:3.0:1762166825.188377:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:48689:x1847765440148096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166825.188394:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166825.188409:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8041 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.188448:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.188457:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.188467:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:3.0:1762166825.188469:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166825.188502:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29000, rc 0) 00000100:00100000:3.0:1762166825.188549:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:48689:x1847765440148096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 172us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166825.188557:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2916 00000100:00100000:2.0:1762166825.190027:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166825.190060:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440148352 00000100:00100000:3.0:1762166825.190065:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440148352 00000100:00100000:3.0:1762166825.190097:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2917 00000100:00100000:3.0:1762166825.190104:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:48689:x1847765440148352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166825.190113:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166825.190115:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762166825.190133:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0cfd5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b801e expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166825.190146:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077700) 00010000:00010000:3.0:1762166825.190154:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166825.190165:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0d04c lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8048 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.190805:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.190817:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.190826:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.190836:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x11:0x0]: returning size 0 00010000:00010000:0.0:1762166825.190877:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0d04c lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.190901:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.190909:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff945bc4077600) 00010000:00010000:0.0:1762166825.190911:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166825.190914:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786bc00, rc 0) 00000100:00100000:0.0:1762166825.190959:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:48689:x1847765440148352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 855us (933us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1762166825.190966:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2917 00000100:00100000:2.0:1762166825.192282:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.192322:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440148608 00000100:00100000:0.0:1762166825.192328:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440148608 00000100:00100000:0.0:1762166825.192365:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2918 00000100:00100000:0.0:1762166825.192373:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:48689:x1847765440148608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.192385:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.192396:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d061 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b804f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.192451:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d068 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.192460:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d068 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.192468:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d068 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.192508:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:0.0:1762166825.192561:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d061 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b804f expref: 24 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.192582:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d068 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b804f expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.192590:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:0.0:1762166825.192593:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166825.192595:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ba00, rc 0) 00000100:00100000:0.0:1762166825.192629:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:48689:x1847765440148608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 258us (349us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1762166825.192637:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2918 00000100:00100000:2.0:1762166825.193874:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.193916:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440148864 00000100:00100000:0.0:1762166825.193923:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440148864 00000100:00100000:0.0:1762166825.193956:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 838 00000100:00100000:0.0:1762166825.193966:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:48689:x1847765440148864:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166825.194003:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0xf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d068 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b804f expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.194024:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.194035:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.194043:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.194071:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.194096:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 23 pid: 6495 timeout: 544 lvb_type: 0 00000100:00100000:0.0:1762166825.194110:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446861568:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166825.194195:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166825.195159:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446861568:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166825.195176:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166825.195574:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166825.195686:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440148992 00000100:00100000:1.0:1762166825.195693:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440148992 00010000:00010000:1.0:1762166825.195731:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 24 pid: 6495 timeout: 544 lvb_type: 0 00000100:00100000:1.0:1762166825.195765:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 691 00000100:00100000:1.0:1762166825.195775:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440148992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166825.195788:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166825.195795:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 24 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.195815:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 24 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.195829:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d045 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8041 expref: 24 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.195850:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:1.0:1762166825.195854:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166825.195861:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166825.195866:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166825.195889:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166825.195913:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.195923:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166825.195929:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440148992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166825.195940:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 691 00010000:00010000:0.0:1762166825.195942:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.195955:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.195976:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.195999:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.196015:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 22 pid: 6495 timeout: 544 lvb_type: 0 00000100:00100000:0.0:1762166825.196037:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446861696:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166825.196088:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166825.196856:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446861696:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166825.196865:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166825.197123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166825.197168:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440149120 00000100:00100000:1.0:1762166825.197173:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440149120 00010000:00010000:1.0:1762166825.197188:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 23 pid: 6495 timeout: 544 lvb_type: 0 00000100:00100000:1.0:1762166825.197215:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 692 00000100:00100000:1.0:1762166825.197222:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440149120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166825.197233:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166825.197239:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 23 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.197250:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 23 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.197275:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d053 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8048 expref: 23 pid: 6495 timeout: 544 lvb_type: 0 00010000:00010000:1.0:1762166825.197287:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff945bc4077600) 00010000:00010000:1.0:1762166825.197291:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166825.197299:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166825.197305:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166825.197324:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166825.197349:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166825.197352:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440149120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (230us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166825.197362:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166825.197367:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 692 00000100:00100000:0.0:1762166825.197596:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446861824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166825.197624:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166825.197649:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166825.197682:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446861824 00000100:00100000:2.0:1762166825.197688:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446861824 00000100:00080000:3.0:1762166825.197740:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166825.197748:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1762166825.197757:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6498:x1847765446861824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166825.197828:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6498:x1847765446861824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166825.197835:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1762166825.197843:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446861824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1762166825.197873:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934602 00000001:00080000:0.0:1762166825.197900:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934603 00010000:00010000:0.0:1762166825.197909:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197914:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197919:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197922:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.197925:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197934:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197940:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff945bc4077600) 00010000:00010000:0.0:1762166825.197942:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166825.197944:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197948:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d07d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x11:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197958:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197962:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197966:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197968:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.197970:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197973:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197976:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:0.0:1762166825.197977:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166825.197979:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 2/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197982:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d076 lrc: 0/0,0 mode: --/EX res: [0x200000405:0xf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.197992:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:0.0:1762166825.197993:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166825.197996:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d068 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b804f expref: 24 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166825.198047:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:48689:x1847765440148864:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4086us (4174us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1762166825.198053:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 838 00000020:00080000:0.0:1762166825.198055:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166825.198835:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.199081:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440149248 00000100:00100000:0.0:1762166825.199086:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440149248 00000100:00100000:0.0:1762166825.199120:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2919 00000100:00100000:0.0:1762166825.199127:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:48689:x1847765440149248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.199140:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.199152:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0d084 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8056 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.199186:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0d084 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8056 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.199197:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0d084 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8056 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.199212:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166825.199214:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166825.199217:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b200, rc 0) 00000100:00100000:0.0:1762166825.199248:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:48689:x1847765440149248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 121us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.199262:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2919 00000100:00100000:2.0:1762166825.200403:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.200440:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440149504 00000100:00100000:0.0:1762166825.200445:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440149504 00000100:00100000:0.0:1762166825.200469:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 839 00000100:00100000:0.0:1762166825.200501:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:48689:x1847765440149504:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166825.200699:0:6498:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166825.200774:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 64 off8320 00000004:00080000:0.0:1762166825.200785:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444349306352ns, next at 445349304294ns, rc = 0 00000001:00080000:0.0:1762166825.200791:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934605 00010000:00010000:0.0:1762166825.200818:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.200827:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.200835:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.200843:0:6498:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.200849:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.200855:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166825.200874:0:6498:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166825.200905:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166825.200914:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166825.200922:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166825.200926:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166825.200933:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166825.200945:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x11:0x0].0x0 (ffff945bc4077800) 00010000:00010000:3.0:1762166825.200954:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166825.200958:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 1/0,0 mode: --/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166825.200964:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d08b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166825.200982:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166825.200985:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166825.200988:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166825.201005:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:48689:x1847765440149504:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 528us (600us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1762166825.201023:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 839 00000020:00080000:0.0:1762166825.201028:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166825.201836:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.201880:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440149760 00000100:00100000:0.0:1762166825.201886:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440149760 00000100:00100000:0.0:1762166825.201917:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 840 00000100:00100000:0.0:1762166825.201925:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:48689:x1847765440149760:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166825.202029:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:48689:x1847765440149760:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 104us (194us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1762166825.202036:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 840 00000100:00100000:2.0:1762166825.213356:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.213461:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440149888 00000100:00100000:0.0:1762166825.213501:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440149888 00000100:00100000:0.0:1762166825.213577:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2920 00000100:00100000:0.0:1762166825.213591:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:48700:x1847765440149888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.213617:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.213637:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b805d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.213701:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213731:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213744:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213760:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213785:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213793:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213871:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d0a7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213879:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213886:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.213925:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1762166825.213928:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166825.213946:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213959:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213964:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213970:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213976:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213982:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.213985:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.213998:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214009:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166825.214013:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.214017:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214022:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214034:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214040:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214045:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214050:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.214053:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214058:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214064:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff945bc4077600) 00010000:00010000:0.0:1762166825.214066:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.214068:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214073:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d0a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.214106:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b805d expref: 29 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.214118:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b805d expref: 28 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.214124:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077000) 00010000:00010000:0.0:1762166825.214126:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166825.214129:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a600, rc 0) 00000100:00100000:0.0:1762166825.214201:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:48700:x1847765440149888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 615us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.214208:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2920 00000100:00100000:2.0:1762166825.215785:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.215880:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440150144 00000100:00100000:0.0:1762166825.215893:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440150144 00000100:00100000:0.0:1762166825.215961:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2921 00000100:00100000:0.0:1762166825.215972:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:48700:x1847765440150144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.215993:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.216011:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d0ae lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8064 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.216103:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216116:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216127:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216159:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216167:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216175:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216243:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216251:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216257:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216263:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216269:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.216273:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216280:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216291:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077000) 00010000:00010000:0.0:1762166825.216294:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.216298:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216304:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d0b5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216328:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216334:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216339:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216344:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.216348:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216354:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216361:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945bc4077d00) 00010000:00010000:0.0:1762166825.216364:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.216367:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216373:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d0bc lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.216405:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d0ae lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8064 expref: 29 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.216417:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077000) 00010000:00010000:0.0:1762166825.216419:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166825.216423:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d0ae lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8064 expref: 29 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.216444:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:0.0:1762166825.216560:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:48700:x1847765440150144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 590us (777us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166825.216568:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2921 00000100:00100000:2.0:1762166825.217957:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.218016:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440150400 00000100:00100000:0.0:1762166825.218023:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440150400 00000100:00100000:0.0:1762166825.218072:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2922 00000100:00100000:0.0:1762166825.218080:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:48700:x1847765440150400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.218096:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.218107:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d0c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b806b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1762166825.218168:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00010000:00010000:0.0:1762166825.218239:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d0c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b806b expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.218249:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166825.218250:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166825.218253:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d0c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b806b expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.218261:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786be00, rc 0) 00000100:00100000:0.0:1762166825.218294:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:48700:x1847765440150400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 217us (343us total) trans 8589934608 rc 301/301 00000100:00100000:0.0:1762166825.218299:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2922 00000100:00100000:2.0:1762166825.219291:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.219332:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440150528 00000100:00100000:0.0:1762166825.219348:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440150528 00000100:00100000:0.0:1762166825.219375:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2923 00000100:00100000:0.0:1762166825.219382:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:48700:x1847765440150528:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166825.219420:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219431:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219437:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219446:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219450:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219453:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219526:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219531:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219534:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.219553:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00000004:00200000:0.0:1762166825.219555:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166825.219560:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219577:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219582:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219585:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219589:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219592:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.219596:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219602:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219610:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077000) 00010000:00010000:0.0:1762166825.219612:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.219616:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219621:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0d1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219632:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219638:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219643:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219653:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.219656:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219661:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219668:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945bc4077300) 00010000:00010000:0.0:1762166825.219670:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.219673:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219677:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0d8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219689:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219695:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219700:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219705:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.219708:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219713:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219731:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166825.219733:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.219742:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.219747:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0df lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166825.219794:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:48700:x1847765440150528:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 411us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.219801:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2923 00000100:00100000:2.0:1762166825.220842:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.220903:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440150784 00000100:00100000:0.0:1762166825.220909:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440150784 00000100:00100000:0.0:1762166825.220957:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 841 00000100:00100000:0.0:1762166825.220967:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:48700:x1847765440150784:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166825.221101:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:48700:x1847765440150784:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 135us (264us total) trans 8589934609 rc 0/0 00000100:00100000:0.0:1762166825.221110:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 841 00000100:00100000:2.0:1762166825.228047:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.228104:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440151040 00000100:00100000:0.0:1762166825.228114:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440151040 00000100:00100000:0.0:1762166825.228164:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2924 00000100:00100000:0.0:1762166825.228170:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:48702:x1847765440151040:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166825.228189:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.228192:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166825.228211:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d0a7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b805d expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.228224:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077000) 00010000:00010000:0.0:1762166825.228231:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166825.228240:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0e6 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8072 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.228367:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228379:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228385:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228394:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228398:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228402:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228441:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d0fb lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228445:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228449:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.228454:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 0 00010000:00010000:0.0:1762166825.228550:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228558:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228575:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228581:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228587:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.228591:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228600:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228611:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077300) 00010000:00010000:0.0:1762166825.228615:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.228619:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228624:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d0ed lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228641:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228648:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228653:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228659:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.228662:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228678:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166825.228689:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166825.228694:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945bc4077d00) 00010000:00010000:0.0:1762166825.228708:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.228714:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.228731:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d0f4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166825.228760:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440151168 00000100:00100000:3.0:1762166825.228772:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440151168 00010000:00010000:0.0:1762166825.228796:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d0e6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8072 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.228812:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d0fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8072 expref: 31 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.228818:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166825.228819:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166825.228821:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786be00, rc 0) 00000100:00100000:3.0:1762166825.228834:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:3.0:1762166825.228851:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765440151168:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166825.228895:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:48702:x1847765440151040:12345-192.168.204.38@tcp:101:dd.0 Request processed in 721us (858us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1762166825.228903:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2924 00000100:00100000:3.0:1762166825.228917:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765440151168:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166825.228928:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 70 00000100:00100000:2.0:1762166825.229936:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.229981:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440151296 00000100:00100000:0.0:1762166825.229989:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440151296 00000100:00100000:0.0:1762166825.230037:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2925 00000100:00100000:0.0:1762166825.230047:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:48702:x1847765440151296:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166825.230060:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.230075:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d109 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8079 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.230096:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d110 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.230105:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d110 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.230112:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d110 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.230176:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d109 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8079 expref: 33 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.230190:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d110 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8079 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.230197:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166825.230199:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166825.230202:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a800, rc 0) 00000100:00100000:0.0:1762166825.230241:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:48702:x1847765440151296:12345-192.168.204.38@tcp:101:dd.0 Request processed in 196us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.230249:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2925 00000100:00100000:2.0:1762166825.231035:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.231082:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440151552 00000100:00100000:0.0:1762166825.231088:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440151552 00000100:00100000:0.0:1762166825.231133:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2926 00000100:00100000:0.0:1762166825.231143:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:48702:x1847765440151552:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1762166825.231170:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166825.231183:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d0fb lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8072 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.231201:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166825.231204:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166825.231306:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 3/0,1 mode: --/PW res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.231317:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.231324:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000001:00080000:0.0:1762166825.231365:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934611 00000004:00010000:0.0:1762166825.231385:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007ea9d323 reply state 000000005734fbd5 transno 8589934612 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.231397:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.231404:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166825.231407:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166825.231409:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166825.231467:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:48702:x1847765440151552:12345-192.168.204.38@tcp:36:dd.0 Request processed in 326us (435us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1762166825.231507:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2926 00000020:00080000:0.0:1762166825.231513:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166825.232282:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.232334:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440151680 00000100:00100000:0.0:1762166825.232341:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440151680 00000100:00100000:0.0:1762166825.232384:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1099 00000100:00100000:0.0:1762166825.232392:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+8:48702:x1847765440151680:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166825.232403:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.232423:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0d11e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8080 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.232445:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 9 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166825.232453:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166825.232455:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166825.232459:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0d11e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8080 expref: 9 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.232512:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 9 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166825.232531:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 9 pid: 8383 timeout: 544 lvb_type: 1 00000100:00100000:0.0:1762166825.232547:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446861952:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166825.232640:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166825.233387:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446861952:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166825.233407:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0d11e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8080 expref: 9 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.233418:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ae00, rc 0) 00000100:00100000:0.0:1762166825.233455:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+9:48702:x1847765440151680:12345-192.168.204.38@tcp:101:dd.0 Request processed in 1064us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.233462:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1099 00000100:00100000:3.0:1762166825.233575:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166825.233650:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440151808 00000100:00100000:1.0:1762166825.233659:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440151808 00010000:00010000:1.0:1762166825.233700:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 9 pid: 8383 timeout: 544 lvb_type: 1 00000100:00100000:1.0:1762166825.233750:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 693 00000100:00100000:1.0:1762166825.233761:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440151808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166825.233776:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166825.233782:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 9 pid: 8383 timeout: 544 lvb_type: 1 00010000:00010000:1.0:1762166825.233813:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 9 pid: 8383 timeout: 544 lvb_type: 1 00010000:00010000:1.0:1762166825.233840:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc13fca00/0x2f180c4effb0cb67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fd1 expref: 9 pid: 8383 timeout: 544 lvb_type: 1 00010000:00010000:1.0:1762166825.233858:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166825.233860:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166825.233866:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0d11e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8080 expref: 8 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.233877:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0d11e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8080 expref: 8 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166825.233914:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0d11e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8080 expref: 8 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166825.233928:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765446862080:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166825.233995:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166825.235060:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765446862080:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166825.235077:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166825.235128:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440151808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1370us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166825.235137:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 693 00000100:00100000:3.0:1762166825.235202:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.235264:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440151936 00000100:00100000:0.0:1762166825.235271:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440151936 00002000:00010000:0.0:1762166825.235311:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/72 (0->18446744073709551615) 00002000:00100000:0.0:1762166825.235316:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db5880 with x1847765440151936 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166825.235324:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db5880. 00000100:00100000:0.0:1762166825.235352:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 495 00000100:00100000:0.0:1762166825.235360:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+8:2418:x1847765440151936:12345-192.168.204.38@tcp:10:dd.0 00002000:00010000:0.0:1762166825.235552:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166825.235556:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb mtime from disk: 1762166797 -> 1762166825 00002000:00010000:0.0:1762166825.235559:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb atime from disk: 1762166797 -> 1762166797 00002000:00010000:0.0:1762166825.235561:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb ctime from disk: 1762166797 -> 1762166825 00002000:00010000:0.0:1762166825.235564:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166825.235616:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440151936:12345-192.168.204.38@tcp:10:dd.0 Request processed in 257us (419us total) trans 17179869391 rc 0/0 00000100:00100000:0.0:1762166825.235625:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 495 00002000:00010000:0.0:1762166825.235631:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/72 (0->18446744073709551615) 00002000:00100000:0.0:1762166825.235634:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db5880 with x1847765440151936 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166825.235641:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db5880. 00000100:00100000:3.0:1762166825.246185:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.246234:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440152192 00000100:00100000:0.0:1762166825.246247:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440152192 00000100:00100000:0.0:1762166825.246306:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 842 00000100:00100000:0.0:1762166825.246315:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:48702:x1847765440152192:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:0.0:1762166825.246667:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:48702:x1847765440152192:12345-192.168.204.38@tcp:35:dd.0 Request processed in 353us (495us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1762166825.246673:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 842 00000100:00100000:2.0:1762166825.253087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.253146:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440152320 00000100:00100000:0.0:1762166825.253177:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440152320 00000100:00100000:0.0:1762166825.253239:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2927 00000100:00100000:0.0:1762166825.253247:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:48704:x1847765440152320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.253276:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.253297:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d125 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8087 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.253365:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253404:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253419:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253438:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253445:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253451:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253593:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d13a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253602:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d13a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253609:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d13a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.253664:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1762166825.253668:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166825.253689:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d13a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253704:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253711:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253729:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253736:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253743:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.253748:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253756:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253770:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166825.253773:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.253778:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253785:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0d12c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253799:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253811:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253817:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253822:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.253825:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253831:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253838:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe7a1a38 (ffff945bc4077300) 00010000:00010000:0.0:1762166825.253840:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.253843:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253849:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0d133 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe7a1a38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.253883:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d125 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8087 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.253896:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d13a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8087 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.253904:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077d00) 00010000:00010000:0.0:1762166825.253906:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166825.253909:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b400, rc 0) 00000100:00100000:0.0:1762166825.253971:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:48704:x1847765440152320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 724us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.253986:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2927 00000100:00100000:2.0:1762166825.255191:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.255232:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440152576 00000100:00100000:0.0:1762166825.255238:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440152576 00000100:00100000:0.0:1762166825.255275:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2928 00000100:00100000:0.0:1762166825.255284:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:48704:x1847765440152576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.255299:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.255313:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d141 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b808e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.255367:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255376:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255382:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255390:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255395:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255399:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255442:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255446:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255459:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255463:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255466:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.255468:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255471:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255498:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077d00) 00010000:00010000:0.0:1762166825.255500:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.255502:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255506:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d148 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255513:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255517:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255520:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255523:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.255525:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255535:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255539:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945bc4077000) 00010000:00010000:0.0:1762166825.255541:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.255542:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255546:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d14f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.255567:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d141 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b808e expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.255582:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077d00) 00010000:00010000:0.0:1762166825.255586:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166825.255589:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d141 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b808e expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.255596:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a400, rc 0) 00000100:00100000:0.0:1762166825.255647:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:48704:x1847765440152576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 364us (461us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166825.255654:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2928 00000100:00100000:3.0:1762166825.256740:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.256788:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440152832 00000100:00100000:0.0:1762166825.256795:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440152832 00000100:00100000:0.0:1762166825.256837:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2929 00000100:00100000:0.0:1762166825.256847:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:48704:x1847765440152832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166825.256861:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166825.256884:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8095 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.256961:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d15d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.256968:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d15d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.256974:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d15d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.256981:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xe:0x0]: returning size 4096 00010000:00010000:0.0:1762166825.257080:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0d156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8095 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.257093:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d15d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8095 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166825.257100:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077d00) 00010000:00010000:0.0:1762166825.257102:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166825.257105:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786b800, rc 0) 00000100:00100000:0.0:1762166825.257147:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:48704:x1847765440152832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 302us (410us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1762166825.257154:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2929 00000100:00100000:2.0:1762166825.257984:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166825.258018:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440152960 00000100:00100000:0.0:1762166825.258023:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440152960 00000100:00100000:0.0:1762166825.258053:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2930 00000100:00100000:0.0:1762166825.258060:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:48704:x1847765440152960:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166825.258110:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258127:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258135:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258149:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258156:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258162:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258217:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258224:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258228:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166825.258253:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0xf:0x0]: returning size 1048576 00000004:00200000:0.0:1762166825.258257:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166825.258267:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258279:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258286:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258305:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258310:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258314:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.258318:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258322:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258330:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077d00) 00010000:00010000:0.0:1762166825.258332:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.258335:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258339:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d16b lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258348:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258350:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258354:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258357:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.258359:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258369:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258374:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0xaf1e71b4 (ffff945bc4077600) 00010000:00010000:0.0:1762166825.258375:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.258377:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258380:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d172 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0xaf1e71b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258389:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258392:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258395:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258397:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166825.258398:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258402:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258405:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166825.258407:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166825.258408:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166825.258411:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d179 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166825.258463:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:48704:x1847765440152960:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 403us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166825.258471:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2930 00010000:00010000:2.0:1762166825.810627:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166826.259678:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446862208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1762166826.259755:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166826.259811:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446862208 00000100:00100000:2.0:1762166826.259824:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446862208 00000100:00080000:3.0:1762166826.259874:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166826.259904:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1762166826.259918:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446862208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1762166826.259944:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3922440192 avail 3690917888 00000100:00100000:2.0:1762166826.260001:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446862208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166826.260010:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1762166826.260038:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446862208:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1762166826.834557:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166827.282703:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166827.282718:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446862464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166827.282735:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446862336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166827.282827:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.282900:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446862464 00000100:00100000:0.0:1762166827.282915:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446862464 00000100:00100000:0.0:1762166827.283004:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1762166827.283015:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.283025:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446862464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1762166827.283099:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1762166827.283106:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446862336 00000100:00100000:1.0:1762166827.283118:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446862336 00000100:00100000:1.0:1762166827.283182:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1762166827.283192:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446862464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.283204:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446862336:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166827.283213:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000004:00000024:1.0:1762166827.283277:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445994496 avail 1299755008 00000100:00100000:0.0:1762166827.283306:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967474 gen 2 00000004:00080000:0.0:1762166827.283317:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967472 committed transno 4294967474 00000004:00080000:0.0:1762166827.283356:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967473 committed transno 4294967474 00000100:00100000:1.0:1762166827.283378:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446862336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (360us total) trans 0 rc 0/0 00000004:00080000:0.0:1762166827.283382:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967474 committed transno 4294967474 00000100:00100000:1.0:1762166827.283398:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1762166827.283422:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446862464:0@lo:41:osp-pre-1-0.0 00000004:00080000:2.0:1762166827.283515:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 446432035735ns, next at 447432031154ns, rc = 0 00000100:00100000:1.0:1762166827.283533:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446862336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166827.283547:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166827.283563:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446862592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166827.283618:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.283637:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446863104:0@lo:400:kworker.0 00000100:00100000:3.0:1762166827.283699:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446862976:0@lo:400:kworker.0 00000100:00100000:1.0:1762166827.283723:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166827.283743:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.283777:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446863104 00000100:00100000:1.0:1762166827.283778:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446863616:0@lo:400:kworker.0 00000100:00100000:3.0:1762166827.283784:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446863488:0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.283784:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446863104 00000100:00100000:0.0:1762166827.283852:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1762166827.283862:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.283871:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446863104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.283942:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446863104:12345-0@lo:400:kworker.0 Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.283950:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1762166827.283965:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446863104:0@lo:400:kworker.0 00000100:00100000:1.0:1762166827.283983:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166827.283999:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1847765446864000:0@lo:400:kworker.0 00000100:00100000:1.0:1762166827.284055:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166827.284165:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446862592 00000100:00100000:3.0:1762166827.284171:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446862592 00000100:00100000:1.0:1762166827.284197:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446862976 00000100:00100000:1.0:1762166827.284206:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446862976 00000100:00100000:3.0:1762166827.284229:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1762166827.284246:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446862592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1762166827.284285:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 51821376 pending 0 free 3921379328 avail 3689857024 00000100:00100000:1.0:1762166827.284294:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446863616 00000100:00100000:1.0:1762166827.284301:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446863616 00000100:00100000:3.0:1762166827.284351:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446862592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.284352:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446864000 00000100:00100000:0.0:1762166827.284360:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446864000 00000100:00100000:3.0:1762166827.284365:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1762166827.284378:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1762166827.284394:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446862976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.284421:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1762166827.284436:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446863616:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1762166827.284511:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1762166827.284519:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166827.284552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.284560:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446863616:12345-0@lo:400:kworker.0 Request processed in 121us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.284562:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446862976:12345-0@lo:400:kworker.0 Request processed in 160us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.284564:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1762166827.284586:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1847765446864000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.284588:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1762166827.284594:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446862592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166827.284603:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1762166827.284618:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446863488 00000100:00100000:0.0:1762166827.284625:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446863488 00000100:00100000:3.0:1762166827.284646:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446862976:0@lo:400:kworker.0 00000100:00100000:2.0:1762166827.284647:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1847765446864000:12345-0@lo:400:kworker.0 Request processed in 68us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.284662:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1762166827.284715:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1762166827.284731:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446863488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166827.284734:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1847765446864000:0@lo:400:kworker.0 00000100:00100000:1.0:1762166827.284792:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446863616:0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.284823:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446863488:12345-0@lo:400:kworker.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.284834:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1762166827.284910:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446862720:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1762166827.284923:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166827.284953:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.284979:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446863232:0@lo:400:kworker.0 00000100:00100000:2.0:1762166827.284986:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446863488:0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.285025:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166827.285054:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446862720 00000100:00100000:3.0:1762166827.285055:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446863232 00000100:00100000:0.0:1762166827.285059:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446863744:0@lo:400:kworker.0 00000100:00100000:2.0:1762166827.285061:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446862720 00000100:00100000:3.0:1762166827.285062:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446863232 00000100:00100000:0.0:1762166827.285115:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166827.285131:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1762166827.285133:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1762166827.285144:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446863232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.285148:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1762166827.285154:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446862720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166827.285160:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446862848:0@lo:400:kworker.0 00002000:00000024:2.0:1762166827.285183:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 43440960 pending 0 free 3922440192 avail 3690917888 00000100:00100000:3.0:1762166827.285221:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446863232:12345-0@lo:400:kworker.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.285224:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166827.285235:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1762166827.285235:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446862720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.285251:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:3.0:1762166827.285274:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166827.285292:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1847765446863360:0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.285324:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.285355:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446863872:0@lo:400:kworker.0 00000100:00100000:2.0:1762166827.285361:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446862848 00000100:00100000:2.0:1762166827.285365:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446862848 00000100:00100000:3.0:1762166827.285368:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446863744 00000100:00100000:3.0:1762166827.285373:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446863744 00000100:00100000:0.0:1762166827.285389:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166827.285407:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1762166827.285411:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446863360 00000100:00100000:3.0:1762166827.285416:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446863360 00000100:00100000:2.0:1762166827.285418:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446862848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.285437:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446862720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166827.285444:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1762166827.285457:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446862848:12345-0@lo:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.285460:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446863232:0@lo:400:kworker.0 00000100:00100000:2.0:1762166827.285469:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1762166827.285534:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446862848:0@lo:400:kworker.0 00000100:00100000:3.0:1762166827.285541:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1762166827.285555:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1847765446863360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.285571:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446863872 00000100:00100000:0.0:1762166827.285576:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446863872 00000100:00100000:3.0:1762166827.285598:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1847765446863360:12345-0@lo:400:kworker.0 Request processed in 48us (272us total) trans 0 rc 0/0 00000100:00080000:2.0:1762166827.285600:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1762166827.285606:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166827.285621:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446863744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.285622:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1762166827.285636:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1762166827.285639:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446863872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166827.285656:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446863744:12345-0@lo:400:kworker.0 Request processed in 181us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.285662:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1762166827.285712:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446863872:12345-0@lo:400:kworker.0 Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.285720:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000004:00080000:3.0:1762166827.285723:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1762166827.285760:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1847765446863360:0@lo:400:kworker.0 00000001:00080000:3.0:1762166827.285766:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:0.0:1762166827.285775:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446863872:0@lo:400:kworker.0 00000100:00100000:0.0:1762166827.285795:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446863744:0@lo:400:kworker.0 00000004:00080000:3.0:1762166827.285799:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1762166827.285850:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446864128:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166827.285855:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166827.285868:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166827.285879:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166827.285883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166827.285896:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.285903:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166827.285913:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166827.285929:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446864128 00000100:00100000:3.0:1762166827.285934:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446864128 00010000:00010000:0.0:1762166827.285944:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166827.285949:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.285955:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166827.285962:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d117 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166827.285969:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1762166827.285979:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446864128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762166827.285997:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:78 count 1 00010000:00010000:3.0:1762166827.286022:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.286042:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 9 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.286051:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.286054:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.286058:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.286096:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 9 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.286112:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 9 pid: 8383 timeout: 546 lvb_type: 1 00000100:00100000:3.0:1762166827.286129:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446864256:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.286193:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166827.287163:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446864256:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166827.287182:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.287337:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.287394:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440153088 00000100:00100000:3.0:1762166827.287400:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440153088 00000100:00080000:2.0:1762166827.287442:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1762166827.287524:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 10 pid: 8383 timeout: 546 lvb_type: 1 00000100:00100000:3.0:1762166827.287560:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 694 00000100:00100000:3.0:1762166827.287571:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440153088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.287585:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.287592:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 10 pid: 8383 timeout: 546 lvb_type: 1 00010000:00010000:3.0:1762166827.287607:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 10 pid: 8383 timeout: 546 lvb_type: 1 00010000:00010000:3.0:1762166827.287632:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc13fc000/0x2f180c4effb0cb52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7fc3 expref: 10 pid: 8383 timeout: 546 lvb_type: 1 00010000:00010000:3.0:1762166827.287648:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.287659:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.287664:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.287674:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.287720:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.287747:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.287759:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.287770:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.287773:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440153088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 203us (435us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166827.287788:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.287794:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 694 00010000:00010000:0.0:1762166827.287823:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166827.287880:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166827.287888:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.287938:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.287944:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.287953:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.287966:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.287973:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d180 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.287993:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166827.288001:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166827.288002:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166827.289102:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446864128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3114us (3207us total) trans 21474836712 rc 0/0 00000100:00100000:0.0:1762166827.289121:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000004:00080000:3.0:1762166827.289141:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5807480/2, rc 0, transno 21474836712 00000100:00100000:3.0:1762166827.289154:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446864128:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1762166827.289961:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836712 is committed 00000001:02000400:1.0:1762166827.350295:0:32925:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50a: mirror extend/copy preserves sparseness ========================================================== 05:47:07 (1762166827) 00000100:00100000:3.0:1762166827.385439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.385540:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440153344 00000100:00100000:1.0:1762166827.385554:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440153344 00000100:00080000:3.0:1762166827.385625:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166827.385660:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2931 00000100:00100000:1.0:1762166827.385672:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:49284:x1847765440153344:12345-192.168.204.38@tcp:36:mkdir.0 00000100:00100000:1.0:1762166827.385821:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446864384:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.385884:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.385937:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446864384 00000100:00100000:1.0:1762166827.385949:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.385951:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446864384 00000100:00100000:0.0:1762166827.386022:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1762166827.386038:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446864384:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.386164:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446864384:12345-0@lo:1000:mdt00_002.0 Request processed in 131us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.386172:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1762166827.386214:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446864384:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.386259:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446864512:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.386282:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.386301:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.386323:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446864512 00000100:00100000:0.0:1762166827.386329:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446864512 00000100:00100000:0.0:1762166827.386361:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1762166827.386370:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446864512:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.386452:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446864512:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (167us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166827.386464:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1762166827.386508:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446864512:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1762166827.386578:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.386588:0:6496:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.386599:0:6496:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.386623:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446864640:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1762166827.386653:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.386690:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.386707:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446864640 00000100:00100000:0.0:1762166827.386713:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446864640 00000100:00100000:0.0:1762166827.386749:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1762166827.386758:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446864640:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1762166827.386770:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.386789:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0d187 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.386816:0:7427:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.386826:0:7427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0d187 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.386868:0:7427:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 14 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.386883:0:7427:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 14 pid: 6495 timeout: 546 lvb_type: 0 00000100:00100000:0.0:1762166827.386897:0:7427:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7427:1847765446864768:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.386985:0:7427:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccafbdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.388002:0:7427:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7427:1847765446864768:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.388034:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0d187 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.388045:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166827.388049:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.388053:0:7427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0d187 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.388062:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:0.0:1762166827.388112:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446864640:12345-0@lo:101:mdt00_002.0 Request processed in 1352us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.388121:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1762166827.388157:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446864640:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1762166827.388176:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.388185:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.388226:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.388318:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440153472 00000100:00100000:1.0:1762166827.388325:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440153472 00000100:00080000:3.0:1762166827.388368:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1762166827.388374:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 15 pid: 6495 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.388415:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 695 00000100:00100000:1.0:1762166827.388426:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440153472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166827.388441:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166827.388448:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 15 pid: 6495 timeout: 546 lvb_type: 0 00010000:00010000:1.0:1762166827.388463:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 15 pid: 6495 timeout: 546 lvb_type: 0 00010000:00010000:1.0:1762166827.388520:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc95c1600/0x2f180c4effb0ce85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ffb expref: 15 pid: 6495 timeout: 546 lvb_type: 0 00010000:00010000:1.0:1762166827.388552:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166827.388559:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0d187 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.388571:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0d187 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.388595:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb0d187 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.388629:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0d187 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.388642:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7421:1847765446864896:0@lo:105: 00000100:00100000:1.0:1762166827.388696:0:7421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.388736:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.388768:0:6478:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1762166827.388783:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446864896 00000100:00100000:0.0:1762166827.388788:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446864896 00000100:00100000:0.0:1762166827.388832:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1762166827.388840:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4856050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:7421:x1847765446864896:12345-0@lo:105: 00010000:00010000:0.0:1762166827.388861:0:6478:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.388871:0:6478:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.388879:0:6478:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.388888:0:6478:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.388895:0:6478:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.388904:0:6478:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.388928:0:6478:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945d00f14400) 00010000:00010000:1.0:1762166827.388942:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.388953:0:6496:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166827.388977:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1762166827.389010:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4856050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:7421:x1847765446864896:12345-0@lo:105: Request processed in 168us (310us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166827.389016:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166827.389022:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1762166827.389028:0:6496:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.389047:0:6496:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.389060:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7421:1847765446864896:0@lo:105: 00000100:00100000:1.0:1762166827.389072:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865024:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1762166827.389102:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166827.389125:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.389149:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446865024 00000100:00100000:1.0:1762166827.389152:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.389156:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446865024 00000100:00100000:3.0:1762166827.389176:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440153472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 745us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.389188:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 695 00000100:00100000:0.0:1762166827.389220:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1762166827.389234:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6496:x1847765446865024:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1762166827.389246:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.389263:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d19c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0d195 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.389298:0:7427:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d19c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0d195 expref: 9 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.389315:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d19c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0d195 expref: 9 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.389323:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7dfb9607 (ffff945bc4077600) 00010000:00010000:0.0:1762166827.389327:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.389331:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:0.0:1762166827.389382:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865024:12345-0@lo:101:mdt00_002.0 Request processed in 152us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.389396:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1762166827.389425:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865024:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1762166827.389443:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.389456:0:6496:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166827.389470:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1762166827.389528:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865152:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.389562:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.389584:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.389609:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446865152 00000100:00100000:0.0:1762166827.389615:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446865152 00000100:00100000:0.0:1762166827.389652:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1762166827.389665:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.389748:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865152:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.389757:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1762166827.389761:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865152:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.389805:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865280:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.389820:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.389838:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.389852:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446865280 00000100:00100000:0.0:1762166827.389857:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446865280 00000100:00100000:0.0:1762166827.389904:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1762166827.389917:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.390000:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865280:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (176us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166827.390008:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1762166827.390033:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865280:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166827.390149:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166827.390199:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166827.390241:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.390265:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446865408 00000100:00100000:0.0:1762166827.390272:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446865408 00000100:00100000:0.0:1762166827.390313:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1762166827.390322:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.390398:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865408:12345-0@lo:1000:mdt00_002.0 Request processed in 78us (198us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166827.390407:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1762166827.390442:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166827.390926:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865536:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166827.390964:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166827.390990:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.391030:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446865536 00000100:00100000:0.0:1762166827.391037:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446865536 00000100:00100000:0.0:1762166827.391088:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1762166827.391103:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.391185:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865536:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.391193:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1762166827.391210:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865536:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166827.391270:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1762166827.391302:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166827.391326:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7969cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.391354:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446865664 00000100:00100000:0.0:1762166827.391360:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446865664 00000100:00100000:0.0:1762166827.391391:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1762166827.391400:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.391468:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6496:x1847765446865664:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.391520:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446865664:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.391528:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000040:00080000:2.0:1762166827.392154:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].9, 992 off42968 00000040:00080000:2.0:1762166827.392231:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].8, 1144 off43912 00000004:00080000:2.0:1762166827.392239:0:6496:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945cf1fe2e40 with version 18 00000004:00080000:0.0:1762166827.392295:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 18 rpc_version 18 00000020:00100000:0.0:1762166827.392327:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166827.392336:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bcbe31880 x1847765446865920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166827.392355:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446865920:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166827.392390:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.392426:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccafbd780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.392441:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446865920 00000100:00100000:1.0:1762166827.392448:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446865920 00000100:00100000:1.0:1762166827.392516:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1762166827.392526:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7425:x1847765446865920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166827.393787:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7425:x1847765446865920:12345-0@lo:1000:osp_up0-1.0 Request processed in 1260us (1393us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1762166827.393807:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1762166827.393864:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446865920:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1762166827.394944:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.394963:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.394986:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00010000:2.0:1762166827.395021:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d42b7b8c reply state 00000000ec53b3f2 transno 4294967475 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.395032:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.395040:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.395044:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166827.395055:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1762166827.395061:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x8:0x0]: returning size 4096 00000004:00080000:2.0:1762166827.395070:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1762166827.395080:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.395087:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.395092:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.395110:0:6496:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1762166827.395114:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1762166827.395120:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.395127:0:6496:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.395132:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166827.395139:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.395147:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14400 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166827.395151:0:6483:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166827.395159:0:6483:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.395190:0:6483:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.395197:0:6483:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1762166827.395212:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:49284:x1847765440153344:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 9541us (9782us total) trans 4294967475 rc 0/0 00010000:00010000:1.0:1762166827.395219:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.395222:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2931 00010000:00010000:1.0:1762166827.395227:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14400/0x2f180c4effb0d187 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb0d18e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.395247:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166827.395253:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166827.395258:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166827.395269:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166827.395286:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446866048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166827.395329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166827.395374:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446866048 00000100:00100000:2.0:1762166827.395380:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446866048 00000100:00100000:2.0:1762166827.395429:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1762166827.395444:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765446866048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.395458:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.395496:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d18e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb0d187 expref: 10 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.395522:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166827.395526:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166827.395560:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765446866048:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.395571:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1762166827.395608:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446866048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1762166827.402090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.402148:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440153600 00000100:00100000:1.0:1762166827.402161:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440153600 00000100:00100000:1.0:1762166827.402225:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2932 00000100:00100000:1.0:1762166827.402237:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:49285:x1847765440153600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.402266:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.402290:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0d1aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b809c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.402363:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0d1b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.402378:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0d1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.402391:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0d1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166827.402444:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166827.402448:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166827.402471:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0d1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.402529:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0d1aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b809c expref: 16 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.402548:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0d1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b809c expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.402558:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166827.402562:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166827.402572:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14c00, rc 0) 00000100:00100000:1.0:1762166827.402649:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:49285:x1847765440153600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 414us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.402657:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2932 00000100:00100000:0.0:1762166827.403666:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.403713:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440153728 00000100:00100000:1.0:1762166827.403719:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440153728 00000100:00100000:1.0:1762166827.403756:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2933 00000100:00100000:1.0:1762166827.403766:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:49285:x1847765440153728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.403781:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.403795:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0d1b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80a3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.403855:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.403865:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.403875:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.403889:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.403899:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d19c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0d195 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.403908:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.403950:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d19c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0d195 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.403983:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446866176:0@lo:104: 00000100:00100000:1.0:1762166827.404039:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.404086:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446866176 00000100:00100000:0.0:1762166827.404091:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446866176 00000100:00100000:1.0:1762166827.404098:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.404128:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1762166827.404140:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6496:x1847765446866176:12345-0@lo:104: 00010000:00010000:0.0:1762166827.404154:0:6478:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.404222:0:6478:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1762166827.404229:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6496:x1847765446866176:12345-0@lo:104: Request processed in 92us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.404237:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1762166827.404247:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446866176:0@lo:104: 00010000:00010000:2.0:1762166827.404265:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166827.404278:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.404279:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.404319:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14a00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:2.0:1762166827.404328:0:10257:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166827.404338:0:10257:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.404379:0:10257:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.404386:0:10257:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166827.404449:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.404452:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446866304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.404461:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945d00f14a00/0x2f180c4effb0d195 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0d19c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.404525:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166827.404543:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166827.404547:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166827.404548:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166827.404617:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446866304 00000100:00100000:2.0:1762166827.404628:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446866304 00010000:00010000:2.0:1762166827.404670:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d19c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0d195 expref: 9 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.404721:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1762166827.404734:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765446866304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.404748:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1762166827.405996:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00010000:00010000:2.0:1762166827.406101:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d19c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0d195 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.406117:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7dfb9607 (ffff945bc4077600) 00010000:00010000:2.0:1762166827.406123:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.406133:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.406141:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.406178:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.406211:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406226:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166827.406264:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446866304:12345-0@lo:103:ldlm_bl.0 Request processed in 1530us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.406275:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1762166827.406315:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446866304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166827.406390:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6496:1847765446866432:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.406456:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.406517:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.406543:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446866432 00000100:00100000:0.0:1762166827.406550:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446866432 00000100:00100000:0.0:1762166827.406605:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:0.0:1762166827.406618:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6496:x1847765446866432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1762166827.406723:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6496:x1847765446866432:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.406729:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1762166827.406768:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6496:1847765446866432:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1762166827.406826:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca400/0x2f180c4effb0d1cd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406841:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca400/0x2f180c4effb0d1cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406850:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca400/0x2f180c4effb0d1cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:1.0:1762166827.406873:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca400/0x2f180c4effb0d1cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406896:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406904:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406910:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406918:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406924:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.406929:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406936:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406948:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166827.406952:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.406957:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406964:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0d1bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406977:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406983:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.406990:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.407001:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.407004:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.407010:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.407016:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7dfb9607 (ffff945bc4077600) 00010000:00010000:1.0:1762166827.407026:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.407030:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.407035:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb0d1c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7dfb9607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.407084:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0d1b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80a3 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.407095:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca400/0x2f180c4effb0d1cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80a3 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.407100:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cd0738500) 00010000:00010000:1.0:1762166827.407102:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166827.407104:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca400, rc 0) 00000100:00100000:1.0:1762166827.407157:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:49285:x1847765440153728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3395us (3495us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.407163:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2933 00000100:00100000:2.0:1762166827.408417:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.408508:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440153856 00000100:00100000:1.0:1762166827.408520:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440153856 00000100:00100000:1.0:1762166827.408603:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2934 00000100:00100000:1.0:1762166827.408622:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:49285:x1847765440153856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.408655:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.408688:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d1d4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.408753:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0d1db lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.408762:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0d1db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.408771:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0d1db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:1.0:1762166827.408829:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1762166827.408834:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1762166827.408871:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d1d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80aa expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.408888:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0d1db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80aa expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.408896:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:1.0:1762166827.408899:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1762166827.408902:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb800, rc 0) 00000100:00100000:1.0:1762166827.408956:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49285:x1847765440153856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 341us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.408962:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2934 00000100:00100000:0.0:1762166827.410090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.410127:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440153984 00000100:00100000:1.0:1762166827.410141:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440153984 00000100:00100000:1.0:1762166827.410178:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2935 00000100:00100000:1.0:1762166827.410185:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49285:x1847765440153984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.410199:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.410211:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d1e2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80b1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.410253:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.410262:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.410269:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411246:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.411265:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411275:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411322:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411329:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411334:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411358:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411361:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.411365:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411370:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411381:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:1.0:1762166827.411383:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.411386:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411390:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d1e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411400:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411403:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411408:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411412:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.411415:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411418:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411431:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738400) 00010000:00010000:1.0:1762166827.411433:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.411435:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411438:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d1f0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.411497:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d1e2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b1 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.411510:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:1.0:1762166827.411512:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.411516:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d1e2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b1 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.411531:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29caa00, rc 0) 00000100:00100000:1.0:1762166827.411601:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49285:x1847765440153984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1413us (1512us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166827.411611:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2935 00000100:00100000:0.0:1762166827.413037:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.413098:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440154240 00000100:00100000:1.0:1762166827.413108:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440154240 00000100:00100000:1.0:1762166827.413181:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2936 00000100:00100000:1.0:1762166827.413203:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49285:x1847765440154240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.413223:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.413238:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d1f7 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.413345:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 3/0,1 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.413358:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.413370:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.413392:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.413402:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.413416:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.413596:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446866560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.413666:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.413743:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446866560 00000100:00100000:1.0:1762166827.413749:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446866560 00000100:00100000:1.0:1762166827.413828:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1762166827.413838:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446866560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1762166827.413904:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6496:x1847765446866560:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.413914:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1762166827.413948:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.413979:0:6496:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934615 gen 2 00000004:00080000:1.0:1762166827.413988:0:6496:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934615 committed transno 8589934615 00000100:00100000:1.0:1762166827.414037:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6496:1847765446866560:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1762166827.414657:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.414693:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414707:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.414721:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 0 00010000:00010000:0.0:1762166827.414754:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414761:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414766:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414771:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414775:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.414779:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414786:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414796:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:0.0:1762166827.414798:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.414803:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 3/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414807:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d1fe lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000004:00010000:0.0:1762166827.414826:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f6d6c431 reply state 0000000090dd182b transno 4294967476 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414834:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.414838:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738a00) 00010000:00010000:0.0:1762166827.414840:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166827.414842:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166827.414870:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d1f7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.414880:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.414885:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.414887:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166827.414889:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0200, rc 0) 00000100:00100000:0.0:1762166827.414967:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:49285:x1847765440154240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1771us (1934us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1762166827.414976:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2936 00000100:00100000:0.0:1762166827.416814:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.416877:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440154496 00000100:00100000:1.0:1762166827.416887:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440154496 00000100:00100000:1.0:1762166827.416949:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2937 00000100:00100000:1.0:1762166827.416966:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:49285:x1847765440154496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.416990:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.417009:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d21a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80bf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.417099:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.417114:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.417123:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.417158:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.417176:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 23 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.417191:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446866688:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.417314:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.418149:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a09500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446866688:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.418176:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.418508:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.418564:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440154624 00000100:00100000:2.0:1762166827.418570:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440154624 00010000:00010000:2.0:1762166827.418602:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 24 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.418635:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 697 00000100:00100000:2.0:1762166827.418650:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440154624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.418662:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.418667:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 24 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.418692:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 24 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.418710:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d20c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80b8 expref: 24 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.418726:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.418730:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.418737:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.418744:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.418770:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.418788:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.418803:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.418814:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440154624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 169us (342us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166827.418819:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 0 00000100:00100000:2.0:1762166827.418827:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 697 00000004:00080000:0.0:1762166827.419036:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1f:0x0], index 0: 0 00010000:00010000:0.0:1762166827.419161:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.419172:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.419180:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.419186:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.419190:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.419198:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.419212:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.419216:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166827.419220:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.419227:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d221 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.419289:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d21a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80bf expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.419301:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:0.0:1762166827.419310:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166827.419315:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d21a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80bf expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.419325:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca800, rc 0) 00000100:00100000:0.0:1762166827.419383:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:49285:x1847765440154496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2422us (2573us total) trans 4294967477 rc 301/301 00000100:00100000:0.0:1762166827.419393:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2937 00000100:00100000:0.0:1762166827.420514:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.420564:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440154880 00000100:00100000:0.0:1762166827.420572:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440154880 00000100:00100000:0.0:1762166827.420629:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 843 00000100:00100000:0.0:1762166827.420646:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:49285:x1847765440154880:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166827.420881:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:49285:x1847765440154880:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 242us (369us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1762166827.420890:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 843 00000100:00100000:0.0:1762166827.421952:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.422010:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440155136 00000100:00100000:1.0:1762166827.422021:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440155136 00000100:00100000:1.0:1762166827.422089:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 844 00000100:00100000:1.0:1762166827.422110:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:49285:x1847765440155136:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166827.422351:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:49285:x1847765440155136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 251us (399us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1762166827.422361:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 844 00000100:00100000:2.0:1762166827.427395:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.427462:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440155392 00000100:00100000:0.0:1762166827.427518:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440155392 00000100:00100000:0.0:1762166827.427613:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2938 00000100:00100000:0.0:1762166827.427630:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:49286:x1847765440155392:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.427660:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.427698:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0d22f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80c6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.427855:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.427878:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.427889:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.427898:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.427902:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.427906:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.427993:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0d244 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.428001:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0d244 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428006:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0d244 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.428017:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 0 00010000:00010000:0.0:1762166827.428108:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428115:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428119:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428123:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428134:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.428138:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428143:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428154:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:0.0:1762166827.428157:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.428160:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428165:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d236 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428177:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428183:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428190:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428195:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.428198:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428204:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428213:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738a00) 00010000:00010000:0.0:1762166827.428216:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.428224:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428228:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d23d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.428265:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb0d22f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80c6 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.428276:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0d244 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80c6 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.428281:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.428283:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166827.428285:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:0.0:1762166827.428350:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:49286:x1847765440155392:12345-192.168.204.38@tcp:101:dd.0 Request processed in 728us (964us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1762166827.428355:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2938 00000100:00100000:0.0:1762166827.429555:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.429615:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440155520 00000100:00100000:0.0:1762166827.429625:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440155520 00000100:00100000:0.0:1762166827.429705:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2939 00000100:00100000:0.0:1762166827.429718:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:49286:x1847765440155520:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.429738:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.429751:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d252 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80cd expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.429774:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.429792:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.429800:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.429899:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d252 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.429928:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.429940:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.429943:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166827.429945:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:0.0:1762166827.429995:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:49286:x1847765440155520:12345-192.168.204.38@tcp:101:dd.0 Request processed in 280us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.430005:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2939 00000100:00100000:1.0:1762166827.431047:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.431103:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440155776 00000100:00100000:0.0:1762166827.431110:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440155776 00000100:00100000:0.0:1762166827.431174:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2940 00000100:00100000:0.0:1762166827.431194:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:49286:x1847765440155776:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1762166827.431242:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.431271:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0d244 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80c6 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.431295:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.431299:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.431557:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.431571:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.431583:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:0.0:1762166827.431637:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967481 00000004:00010000:0.0:1762166827.431668:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000068ca7c98 reply state 00000000d88cf472 transno 4294967482 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.431694:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.431703:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.431707:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166827.431710:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166827.431800:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:49286:x1847765440155776:12345-192.168.204.38@tcp:36:dd.0 Request processed in 616us (759us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1762166827.431811:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2940 00000020:00080000:0.0:1762166827.431817:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166827.432836:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.432878:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440155904 00000100:00100000:0.0:1762166827.432885:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440155904 00000100:00100000:0.0:1762166827.432915:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2941 00000100:00100000:0.0:1762166827.432922:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:49286:x1847765440155904:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.432941:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.432958:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d267 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.433003:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d267 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80d4 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.433023:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d267 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80d4 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.433036:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.433039:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166827.433040:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:0.0:1762166827.433084:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:49286:x1847765440155904:12345-192.168.204.38@tcp:101:dd.0 Request processed in 163us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.433089:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2941 00000100:00100000:1.0:1762166827.434253:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.434307:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440156032 00000100:00100000:0.0:1762166827.434314:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440156032 00000100:00100000:0.0:1762166827.434365:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1101 00000100:00100000:0.0:1762166827.434375:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+9:49286:x1847765440156032:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.434390:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.434411:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80db expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166827.434543:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166827.434568:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.434574:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.434584:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 10 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.434601:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 10 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.434627:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0800, rc 0) 00000100:00100000:0.0:1762166827.434665:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:49286:x1847765440156032:12345-192.168.204.38@tcp:101:dd.0 Request processed in 291us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.434672:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1101 00000100:00100000:2.0:1762166827.435853:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.435951:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440156160 00000100:00100000:0.0:1762166827.435967:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440156160 00002000:00010000:0.0:1762166827.436013:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/31 (1045504->18446744073709551615) 00002000:00100000:0.0:1762166827.436018:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807800 with x1847765440156160 ext(1045504->18446744073709551615) 00002000:00010000:0.0:1762166827.436030:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5807800. 00000100:00100000:0.0:1762166827.436071:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 496 00000100:00100000:0.0:1762166827.436082:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440156160:12345-192.168.204.38@tcp:10:dd.0 00002000:00010000:0.0:1762166827.436347:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 0 -> 1045504 00002000:00010000:0.0:1762166827.436351:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 1762166827 00002000:00010000:0.0:1762166827.436353:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166827.436355:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 0 -> 1762166827 00002000:00010000:0.0:1762166827.436358:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166827.436425:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440156160:12345-192.168.204.38@tcp:10:dd.0 Request processed in 344us (577us total) trans 21474836713 rc 0/0 00000100:00100000:0.0:1762166827.436434:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 496 00002000:00010000:0.0:1762166827.436439:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/31 (1045504->18446744073709551615) 00002000:00100000:0.0:1762166827.436442:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807800 with x1847765440156160 ext(1045504->18446744073709551615) 00002000:00010000:0.0:1762166827.436447:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5807800. 00000100:00100000:1.0:1762166827.438067:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.438124:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440156288 00000100:00100000:0.0:1762166827.438130:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440156288 00002000:00100000:0.0:1762166827.438175:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x1f:0x0] (1044480->1048575) req@ffff945bc4a08e00 x1847765440156288/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 488/0 e 0 to 0 dl 1762166838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166827.438186:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a08e00 with x1847765440156288 ext(1044480->1048575) 00002000:00010000:0.0:1762166827.438191:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a08e00 00000100:00100000:0.0:1762166827.438216:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 497 00000100:00100000:0.0:1762166827.438225:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440156288:12345-192.168.204.38@tcp:3:dd.0 00000100:00100000:0.0:1762166827.438387:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440156288:12345-192.168.204.38@tcp:3:dd.0 Request processed in 163us (324us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166827.438395:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 497 00002000:00100000:0.0:1762166827.438402:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x1f:0x0] (1044480->1048575) req@ffff945bc4a08e00 x1847765440156288/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 488/4536 e 0 to 0 dl 1762166838 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166827.438411:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a08e00 with x1847765440156288 ext(1044480->1048575) 00002000:00010000:0.0:1762166827.438415:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a08e00 00000100:00100000:1.0:1762166827.440584:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.440638:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440156544 00000100:00100000:0.0:1762166827.440646:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440156544 00000100:00100000:0.0:1762166827.440715:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2942 00000100:00100000:0.0:1762166827.440730:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:49286:x1847765440156544:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.440750:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.440754:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166827.440785:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d267 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80d4 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.440805:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.440838:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.440853:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0d275 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.440931:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d27c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.440949:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d27c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.440961:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d27c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00080000:0.0:1762166827.441097:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1d:0x0], index 1: 0 00000004:00080000:0.0:1762166827.441101:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x20:0x0], index 0: 0 00010000:00010000:0.0:1762166827.441187:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d27c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e2 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.441194:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.441196:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762166827.441204:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb0d275 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e2 expref: 32 pid: 6496 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1762166827.441215:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d27c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e2 expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.441233:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.441236:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762166827.441238:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:0.0:1762166827.441293:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:49286:x1847765440156544:12345-192.168.204.38@tcp:101:dd.0 Request processed in 569us (721us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1762166827.441301:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2942 00000100:00100000:1.0:1762166827.442717:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.442772:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440156672 00000100:00100000:0.0:1762166827.442790:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440156672 00002000:00100000:0.0:1762166827.442826:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x1f:0x0] (1044480->1048575) req@ffff945bc4a08000 x1847765440156672/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 4584/0 e 0 to 0 dl 1762166838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166827.442837:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a08000 with x1847765440156672 ext(1044480->1048575) 00002000:00010000:0.0:1762166827.442842:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a08000 00000100:00100000:0.0:1762166827.442871:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 498 00000100:00100000:0.0:1762166827.442882:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440156672:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:0.0:1762166827.443421:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440156672:12345-192.168.204.38@tcp:4:dd.0 Request processed in 542us (709us total) trans 21474836714 rc 0/0 00000100:00100000:0.0:1762166827.443435:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 498 00002000:00100000:0.0:1762166827.443444:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x1f:0x0] (1044480->1048575) req@ffff945bc4a08000 x1847765440156672/t21474836714(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 4584/448 e 0 to 0 dl 1762166838 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166827.443453:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a08000 with x1847765440156672 ext(1044480->1048575) 00002000:00010000:0.0:1762166827.443457:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a08000 00000100:00100000:1.0:1762166827.444656:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.444728:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440156800 00000100:00100000:0.0:1762166827.444739:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440156800 00000100:00100000:0.0:1762166827.444797:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1102 00000100:00100000:0.0:1762166827.444819:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:49286:x1847765440156800:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.444838:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.444868:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80e9 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166827.444985:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166827.445010:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.445013:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.445040:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 14 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.445059:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 14 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.445073:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:0.0:1762166827.445125:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:49286:x1847765440156800:12345-192.168.204.38@tcp:101:dd.0 Request processed in 313us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.445132:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1102 00000100:00100000:1.0:1762166827.447995:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.448068:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440157056 00000100:00100000:0.0:1762166827.448081:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440157056 00000100:00100000:0.0:1762166827.448146:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 845 00000100:00100000:0.0:1762166827.448155:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:49286:x1847765440157056:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:0.0:1762166827.448422:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:49286:x1847765440157056:12345-192.168.204.38@tcp:35:dd.0 Request processed in 267us (439us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1762166827.448431:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 845 00000100:00100000:1.0:1762166827.453598:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.453670:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440157312 00000100:00100000:0.0:1762166827.453696:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440157312 00000100:00100000:0.0:1762166827.453774:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2943 00000100:00100000:0.0:1762166827.453787:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:49287:x1847765440157312:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.453825:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.453857:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d28a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.454046:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.454085:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454099:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454112:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.454119:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454126:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454202:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d29f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.454210:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d29f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454217:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d29f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.454230:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 1065984 00010000:00010000:0.0:1762166827.454337:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454345:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454350:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454357:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454369:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.454375:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454383:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454397:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:0.0:1762166827.454401:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.454406:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454412:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d291 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454428:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454434:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454439:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454443:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.454446:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454451:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454458:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738a00) 00010000:00010000:0.0:1762166827.454461:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.454470:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454502:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d298 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.454559:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d28a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f0 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.454576:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d29f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f0 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.454584:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.454587:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166827.454590:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:0.0:1762166827.454663:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:49287:x1847765440157312:12345-192.168.204.38@tcp:101:dd.0 Request processed in 880us (1092us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1762166827.454670:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2943 00000100:00100000:1.0:1762166827.456104:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.456158:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440157568 00000100:00100000:0.0:1762166827.456167:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440157568 00000100:00100000:0.0:1762166827.456227:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2944 00000100:00100000:0.0:1762166827.456239:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:49287:x1847765440157568:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:0.0:1762166827.456298:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166827.456317:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d27c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e2 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.456336:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d29f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f0 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.456346:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.456364:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.456601:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.456614:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.456623:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:0.0:1762166827.456685:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967486 00000004:00010000:0.0:1762166827.456710:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002277f919 reply state 000000007cea545b transno 4294967487 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.456722:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.456727:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.456729:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166827.456731:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166827.456804:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:49287:x1847765440157568:12345-192.168.204.38@tcp:36:dd.0 Request processed in 568us (710us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1762166827.456809:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2944 00000020:00080000:0.0:1762166827.456814:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166827.457743:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.457783:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440157696 00000100:00100000:0.0:1762166827.457791:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440157696 00000100:00100000:0.0:1762166827.457833:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2945 00000100:00100000:0.0:1762166827.457844:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:49287:x1847765440157696:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.457863:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.457878:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80f7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.457948:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.457961:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.457981:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.457985:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166827.457989:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1c00, rc 0) 00000100:00100000:0.0:1762166827.458032:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:49287:x1847765440157696:12345-192.168.204.38@tcp:101:dd.0 Request processed in 190us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.458040:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2945 00000100:00100000:1.0:1762166827.459269:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.459328:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440157824 00000100:00100000:0.0:1762166827.459336:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440157824 00000100:00080000:3.0:1762166827.459406:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166827.459414:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1103 00000100:00100000:0.0:1762166827.459426:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+9:49287:x1847765440157824:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166827.459448:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.459514:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b80fe expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166827.459751:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166827.459790:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.459793:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.459812:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 10 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.459839:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 10 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.459874:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:0.0:1762166827.459944:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:49287:x1847765440157824:12345-192.168.204.38@tcp:101:dd.0 Request processed in 519us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.459954:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1103 00000100:00100000:1.0:1762166827.462148:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.462774:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440157952 00000100:00100000:0.0:1762166827.462791:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440157952 00000100:00100000:1.0:1762166827.462798:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166827.462864:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/29 (1048576->18446744073709551615) 00002000:00100000:0.0:1762166827.462870:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5ed80 with x1847765440157952 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1762166827.462888:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5f5ed80. 00000100:00100000:2.0:1762166827.462897:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440158080 00000100:00100000:2.0:1762166827.462903:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440158080 00002000:00010000:2.0:1762166827.462921:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/32 (1041408->18446744073709551615) 00002000:00100000:2.0:1762166827.462925:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5dc00 with x1847765440158080 ext(1041408->18446744073709551615) 00000100:00100000:0.0:1762166827.462930:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 499 00002000:00010000:2.0:1762166827.462936:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5f5dc00. 00000100:00100000:0.0:1762166827.462945:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440157952:12345-192.168.204.38@tcp:10:dd.0 00000100:00100000:2.0:1762166827.462959:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 500 00000100:00100000:2.0:1762166827.462969:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440158080:12345-192.168.204.38@tcp:10:dd.0 00002000:00010000:2.0:1762166827.463230:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 0 -> 1041408 00002000:00010000:2.0:1762166827.463237:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime from disk: 0 -> 1762166827 00002000:00010000:0.0:1762166827.463240:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1762166827.463241:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166827.463247:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb mtime from disk: 0 -> 1762166827 00002000:00010000:2.0:1762166827.463248:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime from disk: 0 -> 1762166827 00002000:00010000:0.0:1762166827.463252:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166827.463254:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166827.463255:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb ctime from disk: 0 -> 1762166827 00002000:00010000:0.0:1762166827.463262:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166827.463350:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440157952:12345-192.168.204.38@tcp:10:dd.0 Request processed in 407us (1216us total) trans 17179869392 rc 0/0 00000100:00100000:2.0:1762166827.463351:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440158080:12345-192.168.204.38@tcp:10:dd.0 Request processed in 382us (552us total) trans 21474836715 rc 0/0 00000100:00100000:0.0:1762166827.463370:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 499 00000100:00100000:2.0:1762166827.463378:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 500 00002000:00010000:0.0:1762166827.463379:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/29 (1048576->18446744073709551615) 00002000:00010000:2.0:1762166827.463382:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/32 (1041408->18446744073709551615) 00002000:00100000:0.0:1762166827.463384:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5ed80 with x1847765440157952 ext(1048576->18446744073709551615) 00002000:00100000:2.0:1762166827.463388:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5dc00 with x1847765440158080 ext(1041408->18446744073709551615) 00002000:00010000:0.0:1762166827.463393:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5f5ed80. 00002000:00010000:2.0:1762166827.463397:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5f5dc00. 00000100:00100000:1.0:1762166827.465699:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166827.465740:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869392 is committed 00000001:00080000:3.0:1762166827.465764:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869390 is committed 00000100:00100000:0.0:1762166827.465774:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440158208 00000100:00100000:0.0:1762166827.465784:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440158208 00002000:00100000:0.0:1762166827.465852:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x20:0x0] (1040384->1044479) req@ffff945bc5f5f800 x1847765440158208/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 488/0 e 0 to 0 dl 1762166838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166827.465860:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5f800 with x1847765440158208 ext(1040384->1044479) 00002000:00010000:0.0:1762166827.465865:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5f5f800 00000100:00100000:0.0:1762166827.465889:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 501 00000100:00100000:0.0:1762166827.465896:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440158208:12345-192.168.204.38@tcp:3:dd.0 00000100:00100000:0.0:1762166827.466028:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440158208:12345-192.168.204.38@tcp:3:dd.0 Request processed in 134us (353us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166827.466034:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 501 00002000:00100000:0.0:1762166827.466038:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000400:0x20:0x0] (1040384->1044479) req@ffff945bc5f5f800 x1847765440158208/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 488/4536 e 0 to 0 dl 1762166838 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166827.466044:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5f800 with x1847765440158208 ext(1040384->1044479) 00002000:00010000:0.0:1762166827.466046:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5f5f800 00000100:00100000:1.0:1762166827.470379:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.470448:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440158464 00000100:00100000:0.0:1762166827.470460:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440158464 00000100:00100000:0.0:1762166827.470575:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 846 00000100:00100000:0.0:1762166827.470587:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:49287:x1847765440158464:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:0.0:1762166827.470989:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:49287:x1847765440158464:12345-192.168.204.38@tcp:35:dd.0 Request processed in 405us (636us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1762166827.470996:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 846 00000100:00100000:1.0:1762166827.476285:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.476391:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440158592 00000100:00100000:0.0:1762166827.476411:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440158592 00000100:00100000:0.0:1762166827.476540:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2946 00000100:00100000:0.0:1762166827.476560:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:49288:x1847765440158592:12345-192.168.204.38@tcp:101:truncate.0 00010000:00010000:0.0:1762166827.476632:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.476661:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8105 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.476765:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.476779:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.476789:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.476796:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.476801:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.476805:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.476890:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.476899:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.476905:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.476966:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 2110464 00000004:00200000:0.0:1762166827.476972:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166827.477026:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477047:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477058:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477065:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477072:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477078:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477085:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.477089:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477096:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477110:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:0.0:1762166827.477114:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.477119:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477126:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477142:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477148:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477159:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477164:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.477167:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477172:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477179:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738a00) 00010000:00010000:0.0:1762166827.477182:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.477184:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477189:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2d0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.477217:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8105 expref: 39 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.477227:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8105 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.477232:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.477234:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166827.477236:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0200, rc 0) 00000100:00100000:0.0:1762166827.477326:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:49288:x1847765440158592:12345-192.168.204.38@tcp:101:truncate.0 Request processed in 774us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.477334:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2946 00000100:00100000:1.0:1762166827.478991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.479042:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440158848 00000100:00100000:0.0:1762166827.479054:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440158848 00000100:00100000:0.0:1762166827.479129:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2947 00000100:00100000:0.0:1762166827.479140:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:49288:x1847765440158848:12345-192.168.204.38@tcp:36:truncate.0 00010000:00010000:0.0:1762166827.479223:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.479249:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8105 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.479271:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.479276:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.479544:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.479559:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.479569:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:0.0:1762166827.479637:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967489 00000004:00010000:0.0:1762166827.479666:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008e51641e reply state 0000000026f46ca7 transno 4294967490 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.479706:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.479713:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.479717:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166827.479720:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166827.479860:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:49288:x1847765440158848:12345-192.168.204.38@tcp:36:truncate.0 Request processed in 721us (878us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1762166827.479866:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2947 00000020:00080000:0.0:1762166827.479891:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166827.481430:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.481537:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.481571:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440158976 00000100:00100000:1.0:1762166827.481571:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440159104 00000100:00100000:3.0:1762166827.481580:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440158976 00000100:00100000:1.0:1762166827.481580:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440159104 00002000:00010000:3.0:1762166827.481621:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/29 (2097152->18446744073709551615) 00002000:00010000:1.0:1762166827.481621:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/32 (1602848->18446744073709551615) 00002000:00100000:3.0:1762166827.481626:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5df80 with x1847765440158976 ext(2097152->18446744073709551615) 00002000:00100000:1.0:1762166827.481626:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5d500 with x1847765440159104 ext(1602848->18446744073709551615) 00002000:00010000:3.0:1762166827.481638:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5f5df80. 00002000:00010000:1.0:1762166827.481643:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5f5d500. 00000100:00100000:3.0:1762166827.481725:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 502 00000100:00100000:1.0:1762166827.481731:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 503 00000100:00100000:3.0:1762166827.481735:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440158976:12345-192.168.204.38@tcp:10:truncate.0 00000100:00100000:1.0:1762166827.481737:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440159104:12345-192.168.204.38@tcp:10:truncate.0 00002000:00010000:3.0:1762166827.481911:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1762166827.481911:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 1041408 -> 1602848 00002000:00010000:1.0:1762166827.481915:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:1.0:1762166827.481918:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166827.481920:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:1.0:1762166827.481923:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166827.481956:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:3.0:1762166827.481959:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166827.481966:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:3.0:1762166827.481968:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166827.481988:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440159104:12345-192.168.204.38@tcp:10:truncate.0 Request processed in 237us (438us total) trans 21474836716 rc 0/0 00000100:00100000:3.0:1762166827.481989:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440158976:12345-192.168.204.38@tcp:10:truncate.0 Request processed in 256us (573us total) trans 17179869393 rc 0/0 00000100:00100000:3.0:1762166827.481996:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 502 00000100:00100000:1.0:1762166827.481999:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 503 00002000:00010000:3.0:1762166827.482000:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/29 (2097152->18446744073709551615) 00002000:00100000:3.0:1762166827.482002:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5df80 with x1847765440158976 ext(2097152->18446744073709551615) 00002000:00010000:1.0:1762166827.482002:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/32 (1602848->18446744073709551615) 00002000:00100000:1.0:1762166827.482005:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5d500 with x1847765440159104 ext(1602848->18446744073709551615) 00002000:00010000:3.0:1762166827.482007:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5f5df80. 00002000:00010000:1.0:1762166827.482008:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5f5d500. 00000100:00100000:1.0:1762166827.493928:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.493983:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440159360 00000100:00100000:0.0:1762166827.493995:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440159360 00000100:00100000:0.0:1762166827.494065:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2948 00000100:00100000:0.0:1762166827.494079:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:49289:x1847765440159360:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:0.0:1762166827.494114:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.494142:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2e5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b810c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.494236:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.494251:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494261:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494269:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.494273:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494276:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494420:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.494430:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494437:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.494470:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1762166827.494600:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494609:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494615:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494623:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494629:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.494634:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494640:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494654:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:0.0:1762166827.494657:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.494664:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494670:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d2ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494708:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494715:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494736:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494742:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.494745:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494751:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494759:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738a00) 00010000:00010000:0.0:1762166827.494762:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.494765:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494771:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d2f3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.494835:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d2e5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.494850:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.494857:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.494860:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166827.494863:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:0.0:1762166827.494926:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+42:49289:x1847765440159360:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 852us (1014us total) trans 4294967491 rc 0/0 00000100:00100000:0.0:1762166827.494932:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2948 00000100:00100000:1.0:1762166827.496586:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.496649:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.496687:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440159488 00000100:00100000:3.0:1762166827.496699:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440159488 00000100:00100000:1.0:1762166827.496709:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440159616 00000100:00100000:1.0:1762166827.496715:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440159616 00002000:00100000:1.0:1762166827.496759:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff945bc5807b80 x1847765440159616/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 504/0 e 0 to 0 dl 1762166838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166827.496760:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x1d:0x0] (1048576->1064959) req@ffff945bc5f5d880 x1847765440159488/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 16872/0 e 0 to 0 dl 1762166838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166827.496780:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807b80 with x1847765440159616 ext(0->1048575) 00002000:00100000:3.0:1762166827.496784:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5d880 with x1847765440159488 ext(1048576->1064959) 00002000:00010000:1.0:1762166827.496787:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5807b80 00002000:00010000:3.0:1762166827.496791:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5f5d880 00000100:00100000:1.0:1762166827.496815:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 504 00000100:00100000:1.0:1762166827.496822:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440159616:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:3.0:1762166827.496832:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 505 00000100:00100000:3.0:1762166827.496844:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440159488:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:3.0:1762166827.498063:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440159488:12345-192.168.204.38@tcp:4:dd.0 Request processed in 1217us (1481us total) trans 17179869394 rc 0/0 00000100:00100000:3.0:1762166827.498077:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 505 00002000:00100000:3.0:1762166827.498087:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x1d:0x0] (1048576->1064959) req@ffff945bc5f5d880 x1847765440159488/t17179869394(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 16872/448 e 0 to 0 dl 1762166838 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166827.498096:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5f5d880 with x1847765440159488 ext(1048576->1064959) 00002000:00010000:3.0:1762166827.498101:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5f5d880 00000100:00100000:2.0:1762166827.498521:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440159616:12345-192.168.204.38@tcp:4:dd.0 Request processed in 1696us (1883us total) trans 21474836717 rc 0/0 00000100:00100000:2.0:1762166827.498532:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 504 00002000:00100000:2.0:1762166827.498540:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff945bc5807b80 x1847765440159616/t21474836717(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 504/448 e 0 to 0 dl 1762166838 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166827.498568:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807b80 with x1847765440159616 ext(0->1048575) 00002000:00010000:2.0:1762166827.498572:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5807b80 00000100:00100000:0.0:1762166827.499889:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.499926:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.499960:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440159744 00000100:00100000:2.0:1762166827.499969:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440159744 00000100:00100000:0.0:1762166827.499978:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.500030:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440159872 00000100:00100000:2.0:1762166827.500031:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440160000 00000100:00100000:2.0:1762166827.500037:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440160000 00000100:00100000:1.0:1762166827.500045:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1104 00000100:00100000:3.0:1762166827.500049:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440159872 00000100:00100000:1.0:1762166827.500070:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440159744:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:0.0:1762166827.500073:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1105 00000100:00100000:2.0:1762166827.500088:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1106 00000100:00100000:0.0:1762166827.500091:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440160000:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:2.0:1762166827.500104:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440159872:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:2.0:1762166827.500188:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440159872:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 89us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.500191:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440159744:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.500191:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440160000:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 103us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.500207:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1106 00000100:00100000:0.0:1762166827.500215:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1105 00000100:00100000:1.0:1762166827.500227:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1104 00000100:00100000:1.0:1762166827.501186:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.501228:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440160256 00000100:00100000:0.0:1762166827.501234:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440160256 00000100:00100000:0.0:1762166827.501277:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 847 00000100:00100000:0.0:1762166827.501291:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+42:49289:x1847765440160256:12345-192.168.204.38@tcp:35:lseek_test.0 00000100:00100000:0.0:1762166827.501623:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:49289:x1847765440160256:12345-192.168.204.38@tcp:35:lseek_test.0 Request processed in 332us (438us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1762166827.501633:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 847 00000100:00100000:3.0:1762166827.508037:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.508121:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440160512 00000100:00100000:0.0:1762166827.508139:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440160512 00000100:00100000:0.0:1762166827.508236:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2949 00000100:00100000:0.0:1762166827.508251:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:49290:x1847765440160512:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:0.0:1762166827.508288:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.508320:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d308 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8113 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.508474:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.508512:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.508538:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.508549:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1762166827.508668:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d308 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.508700:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.508707:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.508710:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166827.508712:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:0.0:1762166827.508772:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:49290:x1847765440160512:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 526us (751us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1762166827.508778:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2949 00000100:00100000:1.0:1762166827.510069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.510140:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440160640 00000100:00100000:2.0:1762166827.510146:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440160640 00000100:00100000:2.0:1762166827.510194:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1107 00000100:00100000:2.0:1762166827.510201:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440160640:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:2.0:1762166827.510291:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440160640:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.510296:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1107 00000100:00100000:1.0:1762166827.516613:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.516690:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440160896 00000100:00100000:0.0:1762166827.516703:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440160896 00000100:00100000:0.0:1762166827.516768:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2950 00000100:00100000:0.0:1762166827.516781:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:49291:x1847765440160896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166827.516814:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.516835:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d31d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b811a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.516956:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.516969:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.516992:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.517028:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.517039:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 46 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:0.0:1762166827.517051:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446866816:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.517168:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.517881:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446866816:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.517900:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.518085:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.518132:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440161024 00000100:00100000:2.0:1762166827.518138:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440161024 00010000:00010000:2.0:1762166827.518161:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 47 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.518186:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 698 00000100:00100000:2.0:1762166827.518193:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:2419:x1847765440161024:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.518212:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.518217:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 47 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.518226:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 47 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.518243:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d2fa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b810c expref: 47 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.518257:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.518260:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.518266:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.518271:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.518288:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166827.518322:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440161024:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (237us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166827.518323:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.518331:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 698 00010000:00010000:0.0:1762166827.518338:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.518356:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1762166827.518543:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0d31d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.518557:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.518565:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.518575:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166827.518578:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:0.0:1762166827.518611:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:49291:x1847765440160896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1834us (2013us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1762166827.518619:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2950 00000100:00100000:1.0:1762166827.519804:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.519843:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440161280 00000100:00100000:0.0:1762166827.519852:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440161280 00000100:00100000:0.0:1762166827.519895:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2951 00000100:00100000:0.0:1762166827.519906:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:49291:x1847765440161280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166827.519927:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.519945:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d332 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8121 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.520447:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.520460:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.520494:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.520505:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xc:0x0]: returning size 0 00010000:00010000:0.0:1762166827.520545:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d332 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.520560:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.520568:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034700) 00010000:00010000:0.0:1762166827.520596:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166827.520600:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786bc00, rc 0) 00000100:00100000:0.0:1762166827.520652:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:49291:x1847765440161280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 749us (850us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1762166827.520660:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2951 00000100:00100000:3.0:1762166827.521907:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.521961:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440161536 00000100:00100000:0.0:1762166827.521969:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440161536 00000100:00100000:0.0:1762166827.522016:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2952 00000100:00100000:0.0:1762166827.522034:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:49291:x1847765440161536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166827.522057:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.522072:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d347 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8128 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.522168:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.522185:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.522195:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 4/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.522230:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.522243:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 49 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:0.0:1762166827.522259:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446866944:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.522353:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.523257:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446866944:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.523296:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.523334:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.523380:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440161664 00000100:00100000:2.0:1762166827.523386:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440161664 00010000:00010000:2.0:1762166827.523415:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 50 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.523448:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 699 00000100:00100000:2.0:1762166827.523466:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440161664:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.523514:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.523523:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 50 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.523541:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 50 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.523563:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d339 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8121 expref: 50 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.523585:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034700) 00010000:00010000:2.0:1762166827.523593:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.523603:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.523613:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.523637:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.523662:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.523672:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.523689:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440161664:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.523705:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 699 00000004:00200000:0.0:1762166827.523714:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xc:0x0]: returning size 0 00000004:00080000:0.0:1762166827.523878:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1e:0x0], index 1: 0 00010000:00010000:0.0:1762166827.523978:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.523986:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.523992:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.523998:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.524002:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.524009:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.524025:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034700) 00010000:00010000:0.0:1762166827.524028:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166827.524032:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 2/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.524056:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d34e lrc: 0/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.524110:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d347 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8128 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.524119:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:0.0:1762166827.524122:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166827.524125:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d347 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8128 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.524134:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a400, rc 0) 00000100:00100000:0.0:1762166827.524198:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:49291:x1847765440161536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2167us (2295us total) trans 4294967496 rc 301/301 00000100:00100000:0.0:1762166827.524208:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2952 00000100:00100000:3.0:1762166827.525077:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.525126:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440161920 00000100:00100000:0.0:1762166827.525134:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440161920 00000100:00100000:0.0:1762166827.525179:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 848 00000100:00100000:0.0:1762166827.525187:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+48:49291:x1847765440161920:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166827.525316:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:49291:x1847765440161920:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 131us (247us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1762166827.525322:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 848 00000100:00100000:1.0:1762166827.526122:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.526186:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440162048 00000100:00100000:0.0:1762166827.526191:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440162048 00000100:00100000:0.0:1762166827.526221:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2953 00000100:00100000:0.0:1762166827.526229:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:49291:x1847765440162048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166827.526246:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.526258:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d35c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b812f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.526303:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.526314:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.526319:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.526340:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.526349:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 50 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:0.0:1762166827.526358:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446867072:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.526409:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.527150:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446867072:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.527167:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.527410:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.527454:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440162176 00000100:00100000:2.0:1762166827.527467:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440162176 00010000:00010000:2.0:1762166827.527545:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 51 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.527586:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 700 00000100:00100000:2.0:1762166827.527611:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+51:2419:x1847765440162176:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.527625:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.527631:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 51 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.527641:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 51 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.527661:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d324 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b811a expref: 51 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.527682:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.527685:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.527693:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.527698:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.527722:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.527757:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.527763:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765440162176:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 155us (352us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166827.527766:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.527778:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 700 00000004:00200000:0.0:1762166827.527822:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:0.0:1762166827.527827:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166827.527848:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.527880:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d35c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b812f expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.527896:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b812f expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.527905:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.527908:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166827.527910:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786be00, rc 0) 00000100:00100000:0.0:1762166827.527945:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:49291:x1847765440162048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1717us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.527951:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2953 00000100:00100000:1.0:1762166827.529039:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.529073:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440162304 00000100:00100000:0.0:1762166827.529079:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440162304 00000100:00100000:0.0:1762166827.529117:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2954 00000100:00100000:0.0:1762166827.529127:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:49291:x1847765440162304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166827.529143:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.529158:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d36a lrc: 2/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8136 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.529205:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0d371 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.529217:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0d371 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.529231:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0d371 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.529250:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xc:0x0]: returning size 0 00000004:00200000:0.0:1762166827.529253:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166827.529262:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0d371 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.529275:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d36a lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8136 expref: 51 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.529284:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0d371 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8136 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.529289:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:0.0:1762166827.529291:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166827.529293:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786aa00, rc 0) 00000100:00100000:0.0:1762166827.529323:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:49291:x1847765440162304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 199us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.529327:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2954 00000100:00100000:1.0:1762166827.530407:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.530522:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440162432 00000100:00100000:2.0:1762166827.530530:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440162432 00000100:00100000:2.0:1762166827.530580:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1108 00000100:00100000:2.0:1762166827.530588:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440162432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.530617:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.530635:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b813d expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.530772:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166827.530793:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.530796:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.530806:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.530822:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.530835:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4000, rc 0) 00000100:00100000:2.0:1762166827.530883:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440162432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 295us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.530889:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1108 00000100:00100000:3.0:1762166827.532043:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.532089:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440162688 00000100:00100000:0.0:1762166827.532097:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440162688 00000100:00100000:0.0:1762166827.532141:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2955 00000100:00100000:0.0:1762166827.532152:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:49291:x1847765440162688:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166827.532167:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.532183:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d37f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8144 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.532292:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d386 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.532319:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d386 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.532332:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d386 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:0.0:1762166827.532345:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:0.0:1762166827.532472:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d37f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8144 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.532517:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d386 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8144 expref: 52 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.532526:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.532539:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166827.532542:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a200, rc 0) 00000100:00100000:0.0:1762166827.532588:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:49291:x1847765440162688:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 439us (575us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1762166827.532594:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2955 00000100:00100000:1.0:1762166827.534354:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.534393:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.534411:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440162816 00000100:00100000:2.0:1762166827.534422:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440162816 00000100:00100000:0.0:1762166827.534440:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440162944 00000100:00100000:0.0:1762166827.534445:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440162944 00000100:00100000:1.0:1762166827.534455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.534514:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440163072 00000100:00100000:0.0:1762166827.534517:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440163072 00000100:00100000:0.0:1762166827.534548:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1109 00000100:00100000:3.0:1762166827.534558:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1110 00000100:00100000:0.0:1762166827.534563:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440162944:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166827.534577:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1111 00000100:00100000:3.0:1762166827.534584:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440162816:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166827.534592:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440163072:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166827.534624:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.534625:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.534625:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.534668:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 13 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.534669:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.534670:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.534705:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166827.534708:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.534710:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166827.534710:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166827.534712:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166827.534716:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.534718:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.534719:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.534729:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.534776:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.534776:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 13 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.534777:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.534807:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 13 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.534809:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 19 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:1.0:1762166827.534810:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 19 pid: 8380 timeout: 546 lvb_type: 0 00000100:00100000:0.0:1762166827.534834:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446867200:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.534841:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446867328:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.534842:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446867456:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.534921:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166827.534922:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.534922:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.536033:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446867200:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.536050:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446867456:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.536061:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.536082:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.536474:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446867328:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.536498:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.536547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166827.536567:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.536590:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440163328 00000100:00100000:1.0:1762166827.536599:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440163200 00000100:00100000:2.0:1762166827.536604:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440163328 00000100:00100000:1.0:1762166827.536607:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440163200 00010000:00010000:1.0:1762166827.536642:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 14 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.536653:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 20 pid: 8380 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.536700:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 701 00000100:00100000:1.0:1762166827.536714:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440163200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166827.536715:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.536728:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 702 00010000:00010000:1.0:1762166827.536733:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166827.536734:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440163456 00000100:00100000:2.0:1762166827.536740:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440163456 00000100:00100000:0.0:1762166827.536748:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765440163328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00002000:00010000:1.0:1762166827.536758:0:6481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:0.0:1762166827.536762:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.536772:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 21 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:1.0:1762166827.536772:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 14 pid: 8380 timeout: 546 lvb_type: 0 00002000:00010000:0.0:1762166827.536779:0:6479:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:0.0:1762166827.536803:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 21 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:1.0:1762166827.536836:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 14 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:0.0:1762166827.536872:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 21 pid: 8380 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.536916:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 703 00010000:00010000:0.0:1762166827.536921:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d283 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80e9 expref: 21 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:1.0:1762166827.536923:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d2bb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80fe expref: 14 pid: 8380 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.536943:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440163456:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166827.536958:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.536958:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.536961:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.536963:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.536966:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.536968:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.536978:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166827.536983:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.536995:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.537003:0:7421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 1045504 -> 1048576 00002000:00010000:2.0:1762166827.537007:0:7421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1762166827.537014:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 20 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:1.0:1762166827.537019:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.537028:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.537031:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 20 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.537050:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.537061:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d26e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80db expref: 20 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.537064:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.537081:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440163200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 365us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.537082:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765440163328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 338us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.537117:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 701 00010000:00010000:2.0:1762166827.537124:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166827.537125:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 702 00010000:00010000:3.0:1762166827.537127:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.537127:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.537139:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.537159:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.537162:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.537173:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.537205:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.537223:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.537226:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.537233:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.537241:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.537245:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537271:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537297:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.537297:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.537312:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.537312:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440163456:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 370us (592us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166827.537339:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537347:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.537358:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.537361:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 703 00010000:00010000:0.0:1762166827.537368:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166827.537378:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537382:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.537385:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cac00/0x2f180c4effb0d3a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.537411:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537421:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537431:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166827.537431:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537437:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.537448:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d394 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537452:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.537467:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440163072:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2878us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.537508:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1111 00010000:00010000:1.0:1762166827.537510:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.537520:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d39b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.537551:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440162944:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2992us (3157us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.537562:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1109 00000100:00100000:1.0:1762166827.537577:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440162816:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3007us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.537589:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1110 00000100:00100000:3.0:1762166827.538764:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.538801:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.538827:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440163584 00000100:00100000:1.0:1762166827.538835:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440163584 00000100:00100000:3.0:1762166827.538843:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.538865:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440163840 00000100:00100000:0.0:1762166827.538871:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440163840 00000100:00100000:1.0:1762166827.538873:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440163712 00000100:00100000:1.0:1762166827.538877:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440163712 00000100:00100000:2.0:1762166827.538911:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1112 00000100:00100000:3.0:1762166827.538923:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1113 00000100:00100000:2.0:1762166827.538935:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765440163584:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166827.538936:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1114 00000100:00100000:3.0:1762166827.538937:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765440163840:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166827.538960:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440163712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166827.538965:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.538983:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.538983:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166827.538984:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8159 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.539009:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8152 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166827.539015:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 1602848, mtime: 0x6908882b, atime: 0x0, ctime: 0x6908882b, blocks: 0x38 00010000:00010000:2.0:1762166827.539015:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b814b expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166827.539042:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1d:0x0] initial LVB size: 2097152, mtime: 0x6908882b, atime: 0x0, ctime: 0x6908882b, blocks: 0x20 00010000:00010000:3.0:1762166827.539047:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1762166827.539049:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 1048576, mtime: 0x6908882b, atime: 0x0, ctime: 0x6908882b, blocks: 0x8 00010000:00010000:3.0:1762166827.539052:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.539059:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.539063:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.539070:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.539073:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 13 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.539075:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.539076:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.539096:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 19 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166827.539115:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 13 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.539127:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 19 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.539143:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166827.539147:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a600, rc 0) 00010000:00010000:2.0:1762166827.539168:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4200, rc 0) 00010000:00010000:3.0:1762166827.539169:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28a00, rc 0) 00000100:00100000:3.0:1762166827.539208:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765440163840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 271us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.539209:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2417:x1847765440163712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 254us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.539225:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1113 00000100:00100000:2.0:1762166827.539226:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765440163584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 297us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.539238:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1114 00000100:00100000:2.0:1762166827.539252:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1112 00000100:00100000:2.0:1762166827.561698:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.561749:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.561802:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440163968 00000100:00100000:2.0:1762166827.561805:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.561822:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440163968 00000100:00100000:3.0:1762166827.561835:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440164096 00000100:00100000:3.0:1762166827.561844:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440164096 00000100:00100000:0.0:1762166827.561897:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440164224 00000100:00100000:0.0:1762166827.561902:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440164224 00000100:00100000:3.0:1762166827.561929:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1115 00000100:00100000:1.0:1762166827.561943:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1116 00000100:00100000:3.0:1762166827.561951:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440163968:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166827.561956:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1117 00000100:00100000:1.0:1762166827.561961:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440164096:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166827.561971:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440164224:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166827.562097:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440164224:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 129us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.562098:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440164096:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 143us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.562102:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440163968:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 158us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.562108:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1117 00000100:00100000:3.0:1762166827.562122:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1115 00000100:00100000:1.0:1762166827.562131:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1116 00000100:00100000:1.0:1762166827.563161:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.563204:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440164352 00000100:00100000:0.0:1762166827.563215:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440164352 00000100:00100000:0.0:1762166827.563248:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2956 00000100:00100000:0.0:1762166827.563257:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:49291:x1847765440164352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166827.563278:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.563300:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d3be lrc: 2/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8160 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.563332:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.563345:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.563355:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.563454:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ba00/0x2f180c4effb0d3be lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.563468:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.563530:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:0.0:1762166827.563535:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166827.563539:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a400, rc 0) 00000100:00100000:0.0:1762166827.563576:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:49291:x1847765440164352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 319us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.563584:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2956 00000100:00100000:2.0:1762166827.564545:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.564588:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440164608 00000100:00100000:0.0:1762166827.564596:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440164608 00000100:00100000:0.0:1762166827.564649:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2957 00000100:00100000:0.0:1762166827.564660:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:49291:x1847765440164608:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166827.564714:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.564731:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786aa00/0x2f180c4effb0d371 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8136 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.564740:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:0.0:1762166827.564743:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.564876:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166827.564884:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.564888:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:0.0:1762166827.564924:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1762166827.564938:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005a423e4d reply state 00000000074c4913 transno 4294967500 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.564946:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.564950:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:0.0:1762166827.564952:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166827.564954:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166827.565006:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+55:49291:x1847765440164608:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 350us (470us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1762166827.565010:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2957 00000020:00080000:0.0:1762166827.565014:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166827.565611:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.565651:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440164736 00000100:00100000:0.0:1762166827.565656:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440164736 00000100:00100000:0.0:1762166827.565691:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2958 00000100:00100000:0.0:1762166827.565697:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+55:49291:x1847765440164736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166827.565710:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.565722:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d3d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8167 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.565757:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d3d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8167 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.565770:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d3d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8167 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.565793:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:0.0:1762166827.565795:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166827.565798:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786bc00, rc 0) 00000100:00100000:0.0:1762166827.565831:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:49291:x1847765440164736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 135us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.565836:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2958 00000100:00100000:1.0:1762166827.566617:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.566651:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440164864 00000100:00100000:3.0:1762166827.566655:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440164864 00000100:00100000:3.0:1762166827.566692:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1118 00000100:00100000:3.0:1762166827.566699:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:49291:x1847765440164864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166827.566708:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166827.566721:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b816e expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.566743:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.566767:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.566770:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.566775:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 14 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.566807:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.566819:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 14 pid: 28434 timeout: 546 lvb_type: 1 00000100:00100000:3.0:1762166827.566833:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446867584:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.566926:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166827.567563:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446867584:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166827.567637:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 14 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.567649:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28800, rc 0) 00000100:00100000:3.0:1762166827.567690:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:49291:x1847765440164864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 992us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.567695:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1118 00000100:00100000:1.0:1762166827.567733:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.567776:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440164992 00000100:00100000:3.0:1762166827.567839:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440164992 00010000:00010000:3.0:1762166827.567859:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 14 pid: 28434 timeout: 546 lvb_type: 1 00000100:00100000:3.0:1762166827.567905:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 704 00000100:00100000:3.0:1762166827.567913:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440164992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.567925:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.567931:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 14 pid: 28434 timeout: 546 lvb_type: 1 00010000:00010000:3.0:1762166827.567939:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 14 pid: 28434 timeout: 546 lvb_type: 1 00010000:00010000:3.0:1762166827.567955:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d378 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b813d expref: 14 pid: 28434 timeout: 546 lvb_type: 1 00010000:00010000:3.0:1762166827.567966:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.567967:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.567974:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 13 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.567984:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 13 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.568010:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 13 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.568022:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765446867712:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166827.568066:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166827.568787:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765446867712:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166827.568796:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166827.568820:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440164992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 909us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.568826:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 704 00000100:00100000:2.0:1762166827.568936:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.568981:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440165120 00000100:00100000:1.0:1762166827.568986:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440165120 00002000:00010000:1.0:1762166827.569015:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/30 (0->18446744073709551615) 00002000:00100000:1.0:1762166827.569020:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b7800 with x1847765440165120 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166827.569028:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b7800. 00000100:00100000:1.0:1762166827.569051:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 506 00000100:00100000:1.0:1762166827.569068:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440165120:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166827.569238:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166827.569241:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1762166827 00002000:00010000:1.0:1762166827.569243:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166827.569244:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1762166827 00002000:00010000:1.0:1762166827.569246:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166827.569271:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440165120:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 214us (337us total) trans 17179869395 rc 0/0 00000100:00100000:1.0:1762166827.569276:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 506 00002000:00010000:1.0:1762166827.569278:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/30 (0->18446744073709551615) 00002000:00100000:1.0:1762166827.569281:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b7800 with x1847765440165120 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166827.569284:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b7800. 00000100:00100000:2.0:1762166827.570282:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.570312:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.570341:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440165376 00000100:00100000:3.0:1762166827.570347:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440165376 00000100:00100000:2.0:1762166827.570367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.570395:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440165248 00000100:00100000:0.0:1762166827.570399:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440165504 00000100:00100000:3.0:1762166827.570400:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440165248 00000100:00100000:0.0:1762166827.570407:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440165504 00000100:00100000:2.0:1762166827.570413:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1119 00000100:00100000:2.0:1762166827.570425:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440165376:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166827.570439:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1120 00000100:00100000:3.0:1762166827.570448:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1121 00000100:00100000:1.0:1762166827.570451:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440165248:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.570463:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440165504:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166827.570532:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440165248:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.570546:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1120 00000100:00100000:3.0:1762166827.570549:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440165504:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 87us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.570554:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440165376:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 130us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.570564:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1121 00000100:00100000:2.0:1762166827.570571:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1119 00000100:00100000:2.0:1762166827.571639:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.571666:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.571689:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440165760 00000100:00100000:0.0:1762166827.571695:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440165760 00000100:00100000:3.0:1762166827.571709:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440165632 00000100:00100000:3.0:1762166827.571715:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440165632 00000100:00100000:2.0:1762166827.571715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.571725:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440165888 00000100:00100000:0.0:1762166827.571729:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440165888 00000100:00100000:3.0:1762166827.571753:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1122 00000100:00100000:1.0:1762166827.571760:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1123 00000100:00100000:3.0:1762166827.571765:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440165760:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166827.571771:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1124 00000100:00100000:1.0:1762166827.571774:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440165632:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166827.571783:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440165888:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.571830:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440165760:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.571838:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440165888:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.571839:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1122 00000100:00100000:1.0:1762166827.571839:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440165632:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.571849:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1123 00000100:00100000:0.0:1762166827.571860:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1124 00000100:00100000:0.0:1762166827.572844:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.572886:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440166016 00000100:00100000:1.0:1762166827.572890:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440166016 00000100:00100000:1.0:1762166827.572925:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 507 00000100:00100000:1.0:1762166827.572930:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765440166016:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166827.572964:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.572980:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.572983:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.572989:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.573005:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.573044:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.573125:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440166144 00000100:00100000:3.0:1762166827.573129:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440166144 00010000:00010000:1.0:1762166827.573147:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.573157:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.573158:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 508 00000100:00100000:3.0:1762166827.573167:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765440166144:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166827.573182:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.573184:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.573199:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29caa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.573202:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.573205:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.573206:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.573211:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.573215:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.573220:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.573230:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.573239:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29caa00/0x2f180c4effb0d3e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.573291:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765440166016:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 360us (451us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166827.573300:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 507 00010000:00010000:3.0:1762166827.573868:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.573876:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.573881:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.573884:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.573886:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.573890:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.573897:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.573901:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d3e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.573948:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765440166144:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 783us (906us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1762166827.573954:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 508 00000100:00100000:2.0:1762166827.574946:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.574983:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440166272 00000100:00100000:3.0:1762166827.574989:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440166272 00000100:00100000:3.0:1762166827.575040:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 509 00000100:00100000:3.0:1762166827.575050:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440166272:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166827.575079:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.575091:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 14 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.575096:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.575097:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.575100:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.575129:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 14 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.575139:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 14 pid: 8380 timeout: 546 lvb_type: 0 00000100:00100000:3.0:1762166827.575156:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446867840:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.575234:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166827.575967:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446867840:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166827.575983:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.576209:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.576269:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440166400 00000100:00100000:3.0:1762166827.576275:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440166400 00010000:00010000:3.0:1762166827.576297:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 15 pid: 8380 timeout: 546 lvb_type: 0 00000100:00100000:3.0:1762166827.576328:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 705 00000100:00100000:3.0:1762166827.576335:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440166400:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.576345:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.576367:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 15 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.576385:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 15 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.576409:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d3da lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b816e expref: 15 pid: 8380 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.576422:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.576423:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.576427:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.576435:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.576528:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.576528:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.576540:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.576572:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440166400:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 236us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.576586:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 705 00000001:00080000:3.0:1762166827.578389:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869396 is committed 00002000:00010000:1.0:1762166827.578532:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb size from disk: 0 -> 1069056 00002000:00010000:1.0:1762166827.578538:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb blocks from disk: 0 -> 48 00010000:00010000:1.0:1762166827.578555:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.578566:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.578582:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.578590:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166827.578594:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.578604:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.578619:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.578629:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d3ef lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.578711:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440166272:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3659us (3765us total) trans 17179869396 rc 0/0 00000100:00100000:1.0:1762166827.578726:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 509 00000100:00100000:2.0:1762166827.579872:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.579907:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.579954:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440166528 00000100:00100000:0.0:1762166827.579967:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440166528 00000100:00100000:3.0:1762166827.579973:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440166656 00000100:00100000:3.0:1762166827.579981:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440166656 00000100:00100000:0.0:1762166827.580039:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1125 00000100:00100000:3.0:1762166827.580051:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1126 00000100:00100000:0.0:1762166827.580061:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440166528:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.580073:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440166656:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.580183:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440166656:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 115us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.580186:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440166528:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 132us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.580201:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1126 00000100:00100000:0.0:1762166827.580211:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1125 00000100:00100000:0.0:1762166827.581176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.581210:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.581229:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440166784 00000100:00100000:2.0:1762166827.581234:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440166784 00000100:00100000:3.0:1762166827.581248:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440166912 00000100:00100000:3.0:1762166827.581254:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440166912 00000100:00100000:2.0:1762166827.581266:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1127 00000100:00100000:2.0:1762166827.581274:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440166784:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.581293:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1128 00000100:00100000:3.0:1762166827.581304:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440166912:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.581356:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440166912:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.581356:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440166784:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 81us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.581371:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1128 00000100:00100000:2.0:1762166827.581381:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1127 00000100:00100000:2.0:1762166827.582395:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.582445:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440167040 00000100:00100000:1.0:1762166827.582450:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440167040 00000100:00100000:1.0:1762166827.582519:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 510 00000100:00100000:1.0:1762166827.582530:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765440167040:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166827.582593:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.582610:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.582612:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.582618:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.582633:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.582667:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.582751:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440167168 00000100:00100000:2.0:1762166827.582756:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440167168 00010000:00010000:1.0:1762166827.582767:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.582775:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.582782:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.582786:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166827.582791:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.582799:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 511 00010000:00010000:1.0:1762166827.582800:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.582811:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2416:x1847765440167168:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166827.582819:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.582848:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d3f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.582865:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.582877:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.582879:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.582882:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.582894:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.582900:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765440167040:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 372us (503us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1762166827.582911:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 510 00010000:00010000:2.0:1762166827.582959:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.582968:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.582976:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.582983:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.582987:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.582994:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.583005:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.583023:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4400/0x2f180c4effb0d3fd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.583060:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2416:x1847765440167168:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 252us (394us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1762166827.583068:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 511 00000100:00100000:0.0:1762166827.584045:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.584094:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440167424 00000100:00100000:2.0:1762166827.584100:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440167424 00000100:00100000:2.0:1762166827.584140:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2959 00000100:00100000:2.0:1762166827.584159:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:49291:x1847765440167424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.584176:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.584179:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166827.584202:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786bc00/0x2f180c4effb0d3d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8167 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.584218:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:2.0:1762166827.584223:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.584235:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0d404 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8175 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.584286:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d40b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.584299:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d40b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.584308:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d40b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00080000:2.0:1762166827.584502:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x21:0x0], index 0: 0 00010000:00010000:2.0:1762166827.584628:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d40b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8175 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.584636:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:2.0:1762166827.584639:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166827.584648:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effb0d404 lrc: 0/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8175 expref: 58 pid: 6496 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1762166827.584661:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d40b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8175 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.584695:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:2.0:1762166827.584698:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166827.584701:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4000, rc 0) 00000100:00100000:2.0:1762166827.584745:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:49291:x1847765440167424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 591us (701us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1762166827.584753:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2959 00000100:00100000:3.0:1762166827.586338:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.586389:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440167552 00000100:00100000:2.0:1762166827.586398:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440167552 00000100:00100000:2.0:1762166827.586460:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 512 00000100:00100000:2.0:1762166827.586472:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440167552:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166827.586556:0:23939:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e:0x0] initial LVB size: 1069056, mtime: 0x6908882b, atime: 0x0, ctime: 0x6908882b, blocks: 0x30 00010000:00010000:2.0:1762166827.586567:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.586581:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.586592:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166827.586598:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166827.586599:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.586615:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.586712:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440167680 00000100:00100000:1.0:1762166827.586726:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440167680 00000100:00100000:1.0:1762166827.586815:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 513 00000100:00100000:1.0:1762166827.586827:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440167680:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:1.0:1762166827.586981:0:14623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166827.586991:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.587005:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.587008:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.587012:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.587025:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166827.588259:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836718 is committed 00002000:00010000:1.0:1762166827.588349:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 0 -> 2113536 00002000:00010000:1.0:1762166827.588355:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 0 -> 1762166827 00002000:00010000:1.0:1762166827.588357:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 0 -> 1762166827 00002000:00010000:1.0:1762166827.588359:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:1.0:1762166827.588375:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.588391:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.588398:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.588405:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166827.588409:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.588417:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.588431:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.588438:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb200/0x2f180c4effb0d419 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.588531:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440167680:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1704us (1932us total) trans 21474836718 rc 0/0 00000100:00100000:1.0:1762166827.588543:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 513 00000001:00080000:3.0:1762166827.589441:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869397 is committed 00002000:00010000:2.0:1762166827.589548:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb size from disk: 1069056 -> 2097152 00002000:00010000:2.0:1762166827.589552:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb blocks from disk: 48 -> 64 00010000:00010000:2.0:1762166827.589560:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.589567:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.589572:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.589584:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.589589:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.589594:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.589606:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.589610:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1600/0x2f180c4effb0d412 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.589687:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440167552:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3205us (3341us total) trans 17179869397 rc 0/0 00000100:00100000:2.0:1762166827.589698:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 512 00000100:00100000:0.0:1762166827.590698:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.590757:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440167936 00000100:00100000:2.0:1762166827.590764:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440167936 00000100:00100000:2.0:1762166827.590804:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1129 00000100:00100000:2.0:1762166827.590814:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440167936:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166827.590888:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.590917:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440167936:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.590925:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1129 00000100:00100000:2.0:1762166827.590941:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440167808 00000100:00100000:2.0:1762166827.590945:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440167808 00000100:00100000:2.0:1762166827.590973:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1130 00000100:00100000:2.0:1762166827.590983:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440167808:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166827.591045:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440167808:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.591050:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1130 00000100:00100000:0.0:1762166827.591961:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.591997:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440168192 00000100:00100000:2.0:1762166827.592002:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440168192 00000100:00100000:2.0:1762166827.592034:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2960 00000100:00100000:2.0:1762166827.592039:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:49291:x1847765440168192:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166827.592094:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.592125:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4000/0x2f180c4effb0d40b lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8175 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.592151:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:2.0:1762166827.592155:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.592348:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.592363:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.592373:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:2.0:1762166827.592426:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1762166827.592452:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a1ccfc24 reply state 000000000cf9aff9 transno 4294967503 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.592465:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.592471:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:2.0:1762166827.592474:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166827.592527:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166827.592650:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:49291:x1847765440168192:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 610us (689us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1762166827.592658:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2960 00000020:00080000:2.0:1762166827.592666:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166827.593538:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.593565:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440168320 00000100:00100000:2.0:1762166827.593573:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440168320 00000100:00100000:2.0:1762166827.593613:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2961 00000100:00100000:2.0:1762166827.593623:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:49291:x1847765440168320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.593640:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.593665:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b817c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.593722:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.593749:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.593768:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:2.0:1762166827.593771:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166827.593774:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0200, rc 0) 00000100:00100000:2.0:1762166827.593813:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:49291:x1847765440168320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 192us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.593820:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2961 00000100:00100000:1.0:1762166827.594875:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.594919:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440168448 00000100:00100000:2.0:1762166827.594925:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440168448 00000100:00100000:2.0:1762166827.594954:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1131 00000100:00100000:2.0:1762166827.594959:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:49291:x1847765440168448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.594969:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.594985:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8183 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.595004:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e:0x0] initial LVB size: 2097152, mtime: 0x6908882b, atime: 0x0, ctime: 0x6908882b, blocks: 0x40 00010000:00010000:2.0:1762166827.595017:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.595020:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.595029:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 10 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.595059:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 10 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.595069:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1a00, rc 0) 00000100:00100000:2.0:1762166827.595113:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:49291:x1847765440168448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 153us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.595121:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1131 00000100:00100000:0.0:1762166827.595988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.596037:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440168576 00000100:00100000:2.0:1762166827.596044:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440168576 00000100:00100000:2.0:1762166827.596079:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1132 00000100:00100000:2.0:1762166827.596086:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:49291:x1847765440168576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.596098:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.596114:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b818a expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.596131:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 2113536, mtime: 0x6908882b, atime: 0x0, ctime: 0x6908882b, blocks: 0x20 00010000:00010000:2.0:1762166827.596143:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.596145:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.596150:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 12 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.596162:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 12 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.596170:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c1c00, rc 0) 00000100:00100000:2.0:1762166827.596218:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:49291:x1847765440168576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 132us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.596225:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1132 00000100:00100000:3.0:1762166827.597173:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.597218:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440168704 00000100:00100000:2.0:1762166827.597228:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440168704 00002000:00010000:2.0:1762166827.597255:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/33 (3700000->18446744073709551615) 00002000:00100000:2.0:1762166827.597259:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc95b0000 with x1847765440168704 ext(3700000->18446744073709551615) 00002000:00010000:2.0:1762166827.597267:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc95b0000. 00000100:00100000:2.0:1762166827.597286:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 514 00000100:00100000:2.0:1762166827.597291:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440168704:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166827.597541:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 2113536 -> 3700000 00002000:00010000:2.0:1762166827.597546:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.597549:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166827.597551:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.597554:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1762166827.597615:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440168704:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 322us (443us total) trans 21474836719 rc 0/0 00000100:00100000:2.0:1762166827.597624:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 514 00002000:00010000:2.0:1762166827.597628:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/33 (3700000->18446744073709551615) 00002000:00100000:2.0:1762166827.597631:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc95b0000 with x1847765440168704 ext(3700000->18446744073709551615) 00002000:00010000:2.0:1762166827.597637:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc95b0000. 00000100:00100000:1.0:1762166827.599228:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.599284:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440168832 00000100:00100000:2.0:1762166827.599292:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440168832 00000100:00100000:2.0:1762166827.599341:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 515 00000100:00100000:2.0:1762166827.599349:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440168832:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166827.599379:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599408:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.599411:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.599418:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599432:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599592:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599601:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599610:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599618:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.599622:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599631:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599648:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.599653:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1800/0x2f180c4effb0d43c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.599727:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440168832:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 378us (506us total) trans 0 rc 1312/1312 00000100:00100000:2.0:1762166827.599735:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 515 00000100:00100000:0.0:1762166827.601253:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.601317:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440168960 00000100:00100000:2.0:1762166827.601327:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440168960 00000100:00100000:2.0:1762166827.601383:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 516 00000100:00100000:2.0:1762166827.601390:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440168960:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166827.601421:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.601436:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.601442:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166827.601444:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166827.601447:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.601513:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.601532:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 13 pid: 9165 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.601551:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765446867968:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166827.601668:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166827.602709:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765446867968:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166827.602741:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.602935:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.602975:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440169088 00000100:00100000:3.0:1762166827.602994:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440169088 00010000:00010000:3.0:1762166827.603025:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 14 pid: 9165 timeout: 546 lvb_type: 0 00000100:00100000:3.0:1762166827.603062:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 706 00000100:00100000:3.0:1762166827.603070:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440169088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.603084:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.603107:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 14 pid: 9165 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.603122:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 14 pid: 9165 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.603150:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1c00/0x2f180c4effb0d435 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b818a expref: 14 pid: 9165 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.603166:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.603168:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.603173:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.603184:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.603213:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.603243:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.603255:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.603263:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440169088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.603272:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 706 00000001:00080000:3.0:1762166827.604346:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836720 is committed 00002000:00010000:2.0:1762166827.604425:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 32 -> 40 00010000:00010000:2.0:1762166827.604437:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.604450:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.604457:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.604461:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.604465:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.604470:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.604497:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.604513:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d443 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.604571:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440168960:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3179us (3325us total) trans 21474836720 rc 0/0 00000100:00100000:2.0:1762166827.604580:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 516 00000100:00100000:0.0:1762166827.605404:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.605448:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440169216 00000100:00100000:2.0:1762166827.605455:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440169216 00000100:00100000:2.0:1762166827.605520:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2962 00000100:00100000:2.0:1762166827.605530:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:49291:x1847765440169216:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166827.606632:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967503 is committed 00010000:00010000:0.0:1762166827.606695:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000020:00080000:3.0:1762166827.606703:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf1fe2840 refcount 2 committed 0 result 0 batchid 10 00010000:00010000:0.0:1762166827.606708:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000020:00080000:3.0:1762166827.606709:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5e1e300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1fe2e40 00000020:00080000:3.0:1762166827.606716:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].8 00000020:00080000:3.0:1762166827.606721:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5e1ec00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7b92000 00000020:00080000:3.0:1762166827.606723:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].9 00010000:00010000:0.0:1762166827.606723:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606738:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae5000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.606743:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606752:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000020:00080000:2.0:1762166827.606755:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 10 committed batchid 9 00010000:00010000:0.0:1762166827.606772:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:0.0:1762166827.606776:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.606781:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606786:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae5000/0x2f180c4effb0d1a3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606804:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606810:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606816:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000020:00080000:2.0:1762166827.606818:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00010000:00010000:0.0:1762166827.606826:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.606830:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606837:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606847:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738a00) 00010000:00010000:0.0:1762166827.606858:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.606862:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606869:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d205 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606893:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.606894:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:49291:x1847765440169216:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1362us (1489us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166827.606901:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606916:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.606921:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2962 00010000:00010000:0.0:1762166827.606929:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.606932:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606939:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606950:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.606953:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.606956:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606962:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d260 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606975:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606982:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606994:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.606999:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.607002:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607007:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607014:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.607015:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.607017:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607021:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d2ad lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607028:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607032:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607035:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607038:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.607040:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607044:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607060:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.607063:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.607065:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607071:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0d2de lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607082:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607087:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607092:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607097:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.607100:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607105:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607113:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:0.0:1762166827.607116:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.607118:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607124:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0d3cc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607133:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607141:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607145:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607148:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.607149:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607152:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607158:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:0.0:1762166827.607159:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166827.607161:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.607164:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effb0d420 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.608206:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.608251:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440169344 00000100:00100000:2.0:1762166827.608258:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440169344 00000100:00100000:3.0:1762166827.608288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.608317:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440169472 00000100:00100000:2.0:1762166827.608322:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440169472 00000100:00100000:0.0:1762166827.608361:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1133 00000100:00100000:2.0:1762166827.608374:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1134 00000100:00100000:0.0:1762166827.608394:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440169344:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166827.608395:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440169472:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166827.608548:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440169472:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 161us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.608560:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1134 00000100:00100000:0.0:1762166827.608575:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440169344:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 195us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.608586:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1133 00000100:00100000:2.0:1762166827.615231:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.615280:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.615306:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440169600 00000100:00100000:0.0:1762166827.615319:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440169600 00000100:00100000:2.0:1762166827.615332:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.615356:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440169728 00000100:00100000:3.0:1762166827.615366:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440169728 00000100:00100000:1.0:1762166827.615398:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440169856 00000100:00100000:1.0:1762166827.615406:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440169856 00000100:00100000:0.0:1762166827.615413:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1135 00000100:00100000:3.0:1762166827.615437:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1136 00000100:00100000:0.0:1762166827.615438:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440169600:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166827.615454:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440169728:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166827.615464:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1137 00000100:00100000:2.0:1762166827.615523:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440169856:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166827.615529:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.615550:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.615552:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.615554:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.615565:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615568:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.615571:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.615579:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.615590:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615600:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.615601:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615607:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.615609:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615614:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.615653:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615658:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.615668:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.615688:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615707:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.615718:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.615745:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615755:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.615767:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.615789:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.615804:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615804:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.615805:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166827.615817:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615851:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.615852:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.615855:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615858:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.615902:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615904:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.615910:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.615923:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0d44a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.615972:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d451 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615981:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.615993:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c1400/0x2f180c4effb0d458 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.616053:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440169728:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 603us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.616056:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440169600:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 628us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.616071:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440169856:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 544us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.616086:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1136 00000100:00100000:0.0:1762166827.616099:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1135 00000100:00100000:2.0:1762166827.616110:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1137 00000100:00100000:2.0:1762166827.617140:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.617196:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440170112 00000100:00100000:1.0:1762166827.617203:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440170112 00000100:00100000:1.0:1762166827.617250:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2963 00000100:00100000:1.0:1762166827.617261:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:49291:x1847765440170112:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166827.617355:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.617371:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.617381:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00010000:1.0:1762166827.617552:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000028d2a362 reply state 00000000c6aa5e3a transno 4294967504 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.617565:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.617572:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:1.0:1762166827.617575:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166827.617578:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166827.617660:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:49291:x1847765440170112:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 401us (521us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1762166827.617668:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2963 00000100:00100000:1.0:1762166827.618666:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.618707:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.618715:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440170240 00000100:00100000:0.0:1762166827.618723:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440170240 00000100:00100000:0.0:1762166827.618761:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440170368 00000100:00100000:0.0:1762166827.618765:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440170368 00000100:00100000:2.0:1762166827.618771:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1138 00000100:00100000:2.0:1762166827.618786:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440170240:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166827.618790:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1139 00000100:00100000:3.0:1762166827.618805:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440170368:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166827.618949:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1762166827.618954:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.618957:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb atime from disk: 0 -> 1762166827 00002000:00010000:2.0:1762166827.618965:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.618969:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:3.0:1762166827.618979:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440170368:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 177us (271us total) trans 21474836721 rc 0/0 00000100:00100000:3.0:1762166827.618989:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1139 00000100:00100000:2.0:1762166827.619001:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440170240:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 219us (336us total) trans 17179869398 rc 0/0 00000100:00100000:2.0:1762166827.619011:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1138 00000100:00100000:2.0:1762166827.619788:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.619837:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440170624 00000100:00100000:1.0:1762166827.619842:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440170624 00000100:00100000:1.0:1762166827.619875:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2964 00000100:00100000:1.0:1762166827.619884:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:49291:x1847765440170624:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166827.619948:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.619963:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.619972:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 4/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.620009:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.620024:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 26 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.620041:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446868096:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.620128:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.620910:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446868096:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.620929:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.621111:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.621181:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440170752 00000100:00100000:3.0:1762166827.621199:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440170752 00010000:00010000:3.0:1762166827.621224:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 27 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:3.0:1762166827.621256:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 707 00000100:00100000:3.0:1762166827.621262:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440170752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.621271:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.621276:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 27 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.621285:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 27 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.621301:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0d3c5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8160 expref: 27 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.621313:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:3.0:1762166827.621316:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166827.621322:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166827.621326:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166827.621341:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.621362:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.621369:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.621374:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440170752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.621383:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 707 00010000:00010000:1.0:1762166827.621426:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.621433:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.621438:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.621442:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.621446:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.621451:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.621458:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:1.0:1762166827.621460:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166827.621463:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 2/0,0 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.621467:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d466 lrc: 0/0,0 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.621551:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:49291:x1847765440170624:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1667us (1764us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166827.621560:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2964 00000100:00100000:2.0:1762166827.622413:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.622454:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440171008 00000100:00100000:1.0:1762166827.622460:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440171008 00000100:00100000:1.0:1762166827.622517:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2965 00000100:00100000:1.0:1762166827.622527:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:49291:x1847765440171008:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166827.622586:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166827.622600:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786be00/0x2f180c4effb0d363 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b812f expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.622609:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.622612:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.622649:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.622660:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.622668:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00010000:1.0:1762166827.622804:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003dccc873 reply state 0000000091e695e9 transno 4294967505 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.622818:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.622825:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.622827:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166827.622830:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166827.622899:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:49291:x1847765440171008:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 373us (489us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1762166827.622906:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2965 00000100:00100000:0.0:1762166827.623796:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.623819:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.623838:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.623860:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440171136 00000100:00100000:1.0:1762166827.623871:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440171264 00000100:00100000:2.0:1762166827.623877:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440171136 00000100:00100000:1.0:1762166827.623877:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440171264 00000100:00100000:3.0:1762166827.623896:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440171392 00000100:00100000:3.0:1762166827.623901:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440171392 00000100:00100000:2.0:1762166827.623919:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1140 00000100:00100000:2.0:1762166827.623930:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440171136:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166827.623933:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1141 00000100:00100000:0.0:1762166827.623945:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1142 00000100:00100000:1.0:1762166827.623946:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440171264:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166827.623961:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440171392:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166827.624058:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 1602848 -> 1602848 00002000:00010000:2.0:1762166827.624059:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1762166827.624059:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1762166827.624066:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:1.0:1762166827.624067:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.624068:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:0.0:1762166827.624075:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime from disk: 0 -> 1762166827 00002000:00010000:2.0:1762166827.624076:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 0 -> 1762166827 00002000:00010000:1.0:1762166827.624076:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb atime from disk: 0 -> 1762166827 00002000:00010000:0.0:1762166827.624083:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.624084:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:1.0:1762166827.624084:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.624091:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:1.0:1762166827.624091:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb blocks from disk: 32 -> 32 00002000:00010000:0.0:1762166827.624091:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:1.0:1762166827.624140:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440171264:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 197us (318us total) trans 17179869399 rc 0/0 00000100:00100000:2.0:1762166827.624144:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440171136:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 218us (350us total) trans 21474836723 rc 0/0 00000100:00100000:1.0:1762166827.624147:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1141 00000100:00100000:2.0:1762166827.624150:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1140 00000100:00100000:0.0:1762166827.624156:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440171392:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 200us (315us total) trans 21474836722 rc 0/0 00000100:00100000:0.0:1762166827.624165:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1142 00000100:00100000:0.0:1762166827.625026:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.625083:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440171648 00000100:00100000:1.0:1762166827.625089:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440171648 00000100:00100000:1.0:1762166827.625122:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 849 00000100:00100000:1.0:1762166827.625131:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:49291:x1847765440171648:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166827.625190:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d386 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8144 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.625223:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166827.625236:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.625243:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.625248:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.625253:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 6/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166827.625288:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.625299:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 26 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.625312:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446868224:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.625388:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.625398:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 26 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.625408:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446868352:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.625459:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.625469:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 26 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.625507:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446868480:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.625545:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.626191:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446868224:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.626333:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.626343:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446868352:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166827.626404:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440171904 00000100:00100000:2.0:1762166827.626409:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440171904 00000100:00100000:2.0:1762166827.626456:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 850 00000100:00100000:2.0:1762166827.626468:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:39132:x1847765440171904:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166827.626511:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446868480:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.626548:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166827.626691:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.626723:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:39132:x1847765440171904:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 256us (390us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1762166827.626724:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440172032 00000100:00100000:0.0:1762166827.626730:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440172032 00000100:00100000:2.0:1762166827.626740:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 850 00010000:00010000:0.0:1762166827.626758:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 28 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:0.0:1762166827.626789:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 708 00000100:00100000:0.0:1762166827.626797:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440172032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166827.626798:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166827.626809:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.626816:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 28 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.626824:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440172160 00010000:00010000:0.0:1762166827.626828:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 28 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.626830:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440172160 00010000:00010000:0.0:1762166827.626851:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d2b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80f7 expref: 29 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.626852:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 29 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:0.0:1762166827.626877:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.626882:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.626890:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166827.626897:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 709 00010000:00010000:0.0:1762166827.626899:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166827.626911:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765440172160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.626921:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.626935:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 28 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:0.0:1762166827.626936:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440172032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.626953:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 708 00010000:00010000:2.0:1762166827.626956:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 28 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.626975:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d259 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80cd expref: 27 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.626986:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.626991:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.626997:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.627003:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166827.627043:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765440172160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.627051:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 709 00000100:00100000:1.0:1762166827.627376:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.627418:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440172288 00000100:00100000:2.0:1762166827.627423:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440172288 00010000:00010000:2.0:1762166827.627439:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 26 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.627466:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 710 00000100:00100000:2.0:1762166827.627474:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440172288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.627510:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.627516:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 26 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.627539:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 26 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.627553:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0d30f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8113 expref: 26 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.627564:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.627568:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.627576:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.627583:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.627612:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.627638:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166827.627650:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440172288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 173us (271us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166827.627650:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166827.627666:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 710 00010000:00010000:1.0:1762166827.627691:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166827.627704:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.627712:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 4/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166827.627745:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.627756:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 24 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.627769:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446868608:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.627814:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.628508:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446868608:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.628547:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:0.0:1762166827.628664:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.628711:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440172416 00000100:00100000:2.0:1762166827.628717:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440172416 00010000:00010000:2.0:1762166827.628736:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 25 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.628768:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 711 00000100:00100000:2.0:1762166827.628779:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440172416:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.628789:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.628803:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 25 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.628814:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 25 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.628830:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d427 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b817c expref: 25 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.628842:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:2.0:1762166827.628847:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.628854:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.628861:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.628883:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.628896:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.628905:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:2.0:1762166827.628922:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440172416:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 145us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.628931:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 711 00000100:00100000:0.0:1762166827.629206:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe33b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446868736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.629250:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.629278:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.629301:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446868736 00000100:00100000:1.0:1762166827.629306:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446868736 00000100:00100000:1.0:1762166827.629350:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1762166827.629366:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446868736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.629454:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446868736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.629462:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1762166827.629501:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe33b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446868736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.629566:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446868864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.629605:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.629624:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.629642:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446868864 00000100:00100000:1.0:1762166827.629648:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446868864 00000100:00100000:1.0:1762166827.629686:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1762166827.629694:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446868864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.629755:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446868864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 62us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.629763:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1762166827.629773:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446868864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.629803:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446868992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.629819:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.629838:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.629855:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446868992 00000100:00100000:1.0:1762166827.629858:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446868992 00000100:00100000:1.0:1762166827.629883:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1762166827.629890:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446868992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.629943:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446868992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.629951:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1762166827.629954:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446868992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.629991:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446869120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.630019:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.630037:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.630061:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446869120 00000100:00100000:1.0:1762166827.630066:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446869120 00000100:00100000:1.0:1762166827.630102:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1762166827.630109:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446869120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.630161:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446869120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 52us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.630169:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1762166827.630173:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446869120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.630202:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446869248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.630216:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.630230:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.630239:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446869248 00000100:00100000:1.0:1762166827.630251:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446869248 00000100:00100000:1.0:1762166827.630282:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1762166827.630289:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446869248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.630349:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446869248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.630354:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446869248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.630359:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000040:00080000:0.0:1762166827.630518:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].10, 552 off43520 00000001:00080000:0.0:1762166827.630526:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967507 00000100:00100000:0.0:1762166827.630572:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446869376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.630593:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.630607:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.630623:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446869376 00000100:00100000:1.0:1762166827.630628:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446869376 00000100:00100000:1.0:1762166827.630657:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1762166827.630664:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446869376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.630792:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446869376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (197us total) trans 17179869400 rc 0/0 00000100:00100000:1.0:1762166827.630800:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1762166827.630817:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446869376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.630835:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446869504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166827.630858:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166827.630871:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.630877:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446869504 00000100:00100000:1.0:1762166827.630881:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446869504 00000100:00100000:1.0:1762166827.630905:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1762166827.630911:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc635cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6498:x1847765446869504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.631008:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc635cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6498:x1847765446869504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (146us total) trans 21474836724 rc 0/0 00000100:00100000:0.0:1762166827.631013:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6498:1847765446869504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166827.631020:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000001:00080000:0.0:1762166827.631050:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967508 00010000:00010000:0.0:1762166827.631071:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631077:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631083:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631087:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.631091:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631104:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631115:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:0.0:1762166827.631117:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166827.631120:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 2/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631125:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb0d47b lrc: 0/0,0 mode: --/EX res: [0x240000404:0xc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631135:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631139:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631144:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631147:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166827.631149:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631152:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631157:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.631158:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166827.631159:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631162:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d474 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.631176:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.631177:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166827.631182:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a200/0x2f180c4effb0d386 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8144 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.631255:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:49291:x1847765440171648:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6127us (6232us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1762166827.631261:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 849 00000020:00080000:0.0:1762166827.631265:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166827.632117:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.632163:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440172544 00000100:00100000:1.0:1762166827.632169:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440172544 00000100:00100000:1.0:1762166827.632209:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2966 00000100:00100000:1.0:1762166827.632218:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:49291:x1847765440172544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.632237:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.632257:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8191 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.632326:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.632341:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.632358:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.632362:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166827.632365:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cba00, rc 0) 00000100:00100000:1.0:1762166827.632410:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:49291:x1847765440172544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 190us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.632418:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2966 00000100:00100000:2.0:1762166827.633584:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.633649:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440172800 00000100:00100000:0.0:1762166827.633656:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440172800 00000100:00100000:0.0:1762166827.633700:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 851 00000100:00100000:0.0:1762166827.633707:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:49291:x1847765440172800:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166827.633875:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:49291:x1847765440172800:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 167us (295us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1762166827.633882:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 851 00000100:00100000:3.0:1762166827.634617:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.634654:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440173056 00000100:00100000:0.0:1762166827.634659:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440173056 00000100:00100000:0.0:1762166827.634707:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 852 00000100:00100000:0.0:1762166827.634715:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:49291:x1847765440173056:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166827.634869:0:6498:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166827.634958:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166827.634975:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.635002:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.635012:0:6498:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.635020:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.635026:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.635059:0:6498:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166827.635087:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166827.635103:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.635115:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.635120:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.635155:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.635177:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:2.0:1762166827.635181:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166827.635186:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 1/0,0 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.635192:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d489 lrc: 0/0,0 mode: --/PW res: [0x240000404:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.635213:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166827.635215:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166827.635218:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166827.635234:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:49291:x1847765440173056:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 517us (616us total) trans 4294967511 rc 0/0 00000100:00100000:0.0:1762166827.635243:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 852 00000100:00100000:1.0:1762166827.642812:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.642888:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440173312 00000100:00100000:2.0:1762166827.642904:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440173312 00000100:00100000:2.0:1762166827.642975:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2967 00000100:00100000:2.0:1762166827.642986:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:49293:x1847765440173312:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.643012:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.643032:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d490 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8198 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.643098:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.643111:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643122:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643135:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.643158:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643164:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643234:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643242:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643247:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643253:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643259:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.643263:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643270:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643282:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.643285:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.643289:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643295:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0600/0x2f180c4effb0d497 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643308:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643318:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643340:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643345:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.643352:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643358:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643366:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cc7dfdc00) 00010000:00010000:2.0:1762166827.643368:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.643371:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643376:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1200/0x2f180c4effb0d49e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.643407:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d490 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8198 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.643416:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.643418:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166827.643422:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0200/0x2f180c4effb0d490 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8198 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.643429:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0200, rc 0) 00000100:00100000:2.0:1762166827.643519:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:49293:x1847765440173312:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 534us (721us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166827.643534:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2967 00000100:00100000:1.0:1762166827.644974:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.645018:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440173568 00000100:00100000:2.0:1762166827.645025:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440173568 00000100:00100000:2.0:1762166827.645067:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2968 00000100:00100000:2.0:1762166827.645075:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:49293:x1847765440173568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.645085:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.645097:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b819f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762166827.645161:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1762166827.645253:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b819f expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.645262:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cc7dfd900) 00010000:00010000:2.0:1762166827.645265:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166827.645269:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b819f expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.645281:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0a00, rc 0) 00000100:00100000:2.0:1762166827.645319:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:49293:x1847765440173568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 245us (348us total) trans 4294967512 rc 301/301 00000100:00100000:2.0:1762166827.645325:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2968 00000100:00100000:3.0:1762166827.646190:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.646234:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440173696 00000100:00100000:2.0:1762166827.646240:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440173696 00000100:00100000:2.0:1762166827.646274:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2969 00000100:00100000:2.0:1762166827.646281:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:49293:x1847765440173696:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166827.646318:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.646337:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646346:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646357:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.646364:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646369:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646415:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.646423:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646429:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166827.646458:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:2.0:1762166827.646462:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166827.646469:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646509:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646517:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646532:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646538:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646543:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.646547:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646553:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646572:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.646575:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.646578:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646584:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646594:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646600:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646605:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646610:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.646612:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646628:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646635:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cc7dfde00) 00010000:00010000:2.0:1762166827.646637:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.646640:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646645:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4ba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646656:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646662:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646667:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646684:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.646687:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646693:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646700:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.646702:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.646705:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.646710:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.646775:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:49293:x1847765440173696:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 494us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.646783:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2969 00000100:00100000:1.0:1762166827.648125:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.648226:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440173952 00000100:00100000:0.0:1762166827.648237:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440173952 00000100:00100000:0.0:1762166827.648293:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 853 00000100:00100000:0.0:1762166827.648303:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:49293:x1847765440173952:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166827.648589:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:49293:x1847765440173952:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 286us (475us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1762166827.648599:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 853 00000100:00100000:1.0:1762166827.657154:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.657240:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440174208 00000100:00100000:2.0:1762166827.657253:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440174208 00000100:00100000:2.0:1762166827.657321:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2970 00000100:00100000:2.0:1762166827.657333:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:49297:x1847765440174208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.657366:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.657391:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81a6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.657502:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.657517:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657531:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657546:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.657553:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657560:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657714:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.657745:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657752:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166827.657764:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1762166827.657877:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657886:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657892:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657897:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657901:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.657905:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657910:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657921:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.657924:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.657929:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657935:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1400/0x2f180c4effb0d4cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657961:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657968:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657974:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657977:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.657980:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657984:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657988:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cc7dfde00) 00010000:00010000:2.0:1762166827.657989:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.657991:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.657994:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1e00/0x2f180c4effb0d4d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.658032:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.658047:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.658055:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.658063:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166827.658066:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc95c0a00, rc 0) 00000100:00100000:2.0:1762166827.658136:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:49297:x1847765440174208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 804us (997us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1762166827.658145:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2970 00000100:00100000:3.0:1762166827.681018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.681105:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440174336 00000100:00100000:2.0:1762166827.681120:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440174336 00000100:00100000:2.0:1762166827.681214:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 517 00000100:00100000:2.0:1762166827.681227:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440174336:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166827.681273:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.681293:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.681295:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.681302:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.681318:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.681549:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.681597:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440174464 00000100:00100000:3.0:1762166827.681602:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440174464 00000100:00100000:3.0:1762166827.681644:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 518 00000100:00100000:3.0:1762166827.681653:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440174464:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166827.681683:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.681692:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.681695:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.681698:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.681709:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.681913:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.681959:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440174592 00000100:00100000:0.0:1762166827.681965:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440174592 00000100:00100000:0.0:1762166827.682014:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 519 00000100:00100000:0.0:1762166827.682023:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440174592:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166827.682044:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.682061:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.682064:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.682067:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.682079:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.682871:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.682908:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440174720 00000100:00100000:1.0:1762166827.682915:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440174720 00000100:00100000:1.0:1762166827.682971:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 520 00000100:00100000:1.0:1762166827.682980:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440174720:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166827.683009:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.683037:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.683040:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.683046:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.683059:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.689025:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.689043:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.689051:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.689059:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166827.689063:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.689072:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.689091:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.689099:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0400/0x2f180c4effb0d4eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.689189:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440174336:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 7961us (8185us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1762166827.689201:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 517 00010000:00010000:1.0:1762166827.690004:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.690015:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.690022:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.690028:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166827.690032:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.690038:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.690050:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.690057:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb000/0x2f180c4effb0d500 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.690107:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440174720:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 7128us (7245us total) trans 0 rc 554272/554272 00000100:00100000:1.0:1762166827.690125:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 520 00010000:00010000:0.0:1762166827.691573:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.691593:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.691602:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.691609:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166827.691614:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.691622:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.691639:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.691646:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d4f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.691759:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440174592:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 9733us (9842us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166827.691769:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 519 00010000:00010000:3.0:1762166827.692111:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.692120:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.692124:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.692137:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.692139:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.692144:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.692151:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.692156:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0d4f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.692206:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440174464:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 10554us (10658us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166827.692214:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 518 00000100:00100000:2.0:1762166827.710839:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.710917:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440174976 00000100:00100000:0.0:1762166827.710931:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440174976 00000100:00100000:0.0:1762166827.711004:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 854 00000100:00100000:0.0:1762166827.711018:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:49297:x1847765440174976:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166827.711309:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:49297:x1847765440174976:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 293us (480us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1762166827.711318:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 854 00000100:00100000:2.0:1762166827.721413:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.721521:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440175232 00000100:00100000:1.0:1762166827.721535:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440175232 00000100:00100000:1.0:1762166827.721614:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2971 00000100:00100000:1.0:1762166827.721624:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:49300:x1847765440175232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.721652:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.721689:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d507 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81ad expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.721811:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.721824:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.721833:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:1.0:1762166827.721842:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1762166827.721952:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d507 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.721973:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.721982:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.721986:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166827.721990:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cac00, rc 0) 00000100:00100000:1.0:1762166827.722062:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:49300:x1847765440175232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 439us (663us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1762166827.722085:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2971 00000100:00100000:2.0:1762166827.746003:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.746075:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440175360 00000100:00100000:3.0:1762166827.746200:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440175360 00000100:00100000:2.0:1762166827.746248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.746325:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440175488 00000100:00100000:0.0:1762166827.746331:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440175488 00000100:00100000:3.0:1762166827.746338:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 521 00000100:00100000:3.0:1762166827.746353:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440175360:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166827.746395:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 522 00010000:00010000:3.0:1762166827.746399:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.746409:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440175488:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166827.746428:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 12 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.746438:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00002000:00010000:0.0:1762166827.746461:0:16567:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 3700000, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x28 00010000:00010000:3.0:1762166827.746462:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.746468:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.746472:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.746528:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.746533:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.746541:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.746555:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.746568:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 12 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.746589:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 12 pid: 9165 timeout: 546 lvb_type: 0 00000100:00100000:3.0:1762166827.746608:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446869632:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.746748:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166827.747681:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446869632:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166827.747778:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.747841:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.747883:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440175616 00000100:00100000:3.0:1762166827.747890:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440175616 00010000:00010000:3.0:1762166827.747913:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 13 pid: 9165 timeout: 546 lvb_type: 0 00000100:00100000:3.0:1762166827.747942:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 712 00000100:00100000:3.0:1762166827.747947:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440175616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.747958:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.747977:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 13 pid: 9165 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.747997:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 13 pid: 9165 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.748015:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effb0d42e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8183 expref: 13 pid: 9165 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.748028:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.748029:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.748032:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.748038:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.748060:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.748087:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.748099:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.748105:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440175616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 154us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.748123:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 712 00010000:00010000:0.0:1762166827.753400:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.753421:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.753431:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.753438:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166827.753443:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.753453:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.753517:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.753531:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d523 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.753656:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440175488:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 7247us (7403us total) trans 0 rc 1602848/1602848 00000100:00100000:0.0:1762166827.753667:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 522 00010000:00010000:1.0:1762166827.755237:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.755255:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.755263:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.755270:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166827.755274:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.755282:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.755300:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.755308:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0d51c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.755409:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440175360:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 9057us (9419us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1762166827.755420:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 521 00000100:00100000:3.0:1762166827.772535:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.772616:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440175744 00000100:00100000:0.0:1762166827.772646:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440175744 00000100:00100000:2.0:1762166827.772683:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.772717:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440175872 00000100:00100000:0.0:1762166827.772720:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440175872 00000100:00100000:3.0:1762166827.772746:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1143 00000100:00100000:0.0:1762166827.772757:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1144 00000100:00100000:3.0:1762166827.772764:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440175744:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166827.772774:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765440175872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166827.772792:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166827.772792:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166827.772825:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81b4 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.772825:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81bb expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166827.772870:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e:0x0] initial LVB size: 2097152, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x40 00002000:00010000:0.0:1762166827.772870:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 3700000, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x28 00010000:00010000:3.0:1762166827.772895:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.772895:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.772900:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.772901:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.772915:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 15 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.772916:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 12 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.772946:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 12 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166827.772947:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 15 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.772974:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29600, rc 0) 00010000:00010000:0.0:1762166827.772974:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:0.0:1762166827.773035:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440175872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 270us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.773039:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440175744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 281us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.773046:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1144 00000100:00100000:3.0:1762166827.773055:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1143 00000100:00100000:2.0:1762166827.787379:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.787462:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440176128 00000100:00100000:1.0:1762166827.787511:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440176128 00000100:00100000:1.0:1762166827.787586:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2972 00000100:00100000:1.0:1762166827.787600:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:49302:x1847765440176128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.787640:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.787696:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d538 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81c2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.787877:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.787895:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.787904:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 4/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.787948:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.787965:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 36 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.787985:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446869760:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.788138:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166827.789367:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446869760:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166827.789435:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.789578:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.789728:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440176256 00000100:00100000:2.0:1762166827.789738:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440176256 00010000:00010000:2.0:1762166827.789816:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 37 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.789883:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 713 00000100:00100000:2.0:1762166827.789894:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440176256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.789912:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.789921:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 37 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.789953:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 37 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.789982:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0a00/0x2f180c4effb0d4dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81a6 expref: 37 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.790021:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.790048:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.790074:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.790084:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.790118:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.790146:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.790156:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:1.0:1762166827.790177:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000100:00100000:2.0:1762166827.790203:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440176256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 310us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.790214:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 713 00010000:00010000:1.0:1762166827.790403:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb0d538 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.790421:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.790428:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.790431:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166827.790434:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb200, rc 0) 00000100:00100000:1.0:1762166827.790571:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:49302:x1847765440176128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2974us (3208us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1762166827.790579:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2972 00000100:00100000:3.0:1762166827.791097:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.791157:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440176384 00000100:00100000:1.0:1762166827.791163:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440176384 00002000:00100000:1.0:1762166827.791195:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x48:0x0] (0->1048575) req@ffff945bc95b1f80 x1847765440176384/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 488/0 e 0 to 0 dl 1762166838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166827.791202:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc95b1f80 with x1847765440176384 ext(0->1048575) 00002000:00010000:1.0:1762166827.791206:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc95b1f80 00000100:00100000:1.0:1762166827.791232:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 523 00000100:00100000:1.0:1762166827.791239:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440176384:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:3.0:1762166827.791872:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.791940:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440176512 00000100:00100000:2.0:1762166827.791946:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440176512 00000100:00100000:2.0:1762166827.791988:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2973 00000100:00100000:2.0:1762166827.791996:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:49302:x1847765440176512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.792014:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.792029:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d54d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81c9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.792101:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.792113:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.792121:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.792152:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.792166:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 37 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.792181:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446869888:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166827.792239:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166827.793343:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.793377:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446869888:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.793406:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166827.793433:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440176640 00000100:00100000:0.0:1762166827.793439:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440176640 00010000:00010000:0.0:1762166827.793466:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 38 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:0.0:1762166827.793548:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 714 00000100:00100000:0.0:1762166827.793564:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440176640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166827.793586:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.793594:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 38 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:0.0:1762166827.793608:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 38 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:0.0:1762166827.793624:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d53f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c2 expref: 38 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:0.0:1762166827.793636:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166827.793639:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.793648:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.793654:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166827.793684:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.793718:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166827.793726:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440176640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 167us (382us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166827.793730:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166827.793739:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 714 00000004:00200000:1.0:1762166827.793783:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:1.0:1762166827.793790:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166827.793815:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.793854:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d54d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.793881:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.793890:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.793892:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166827.793894:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:1.0:1762166827.793931:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:49302:x1847765440176512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1935us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.793941:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2973 00000100:00100000:2.0:1762166827.795994:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.796044:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.796096:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440176768 00000100:00100000:2.0:1762166827.796106:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440176896 00000100:00100000:0.0:1762166827.796107:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440176768 00000100:00100000:2.0:1762166827.796127:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440176896 00000100:00100000:0.0:1762166827.796191:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1145 00000100:00100000:2.0:1762166827.796218:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1146 00000100:00100000:0.0:1762166827.796218:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440176768:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166827.796245:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440176896:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166827.796275:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.796284:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166827.796299:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.796306:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440177024 00000100:00100000:3.0:1762166827.796315:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440177024 00000100:00100000:3.0:1762166827.796370:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1147 00010000:00010000:2.0:1762166827.796370:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 14 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166827.796377:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 16 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.796407:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.796412:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.796413:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.796417:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.796420:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.796425:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.796444:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440177024:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166827.796524:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 14 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166827.796545:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 16 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.796547:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 14 pid: 8383 timeout: 546 lvb_type: 1 00010000:00010000:3.0:1762166827.796604:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.796605:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446870016:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.796606:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 16 pid: 9168 timeout: 546 lvb_type: 1 00000100:00100000:0.0:1762166827.796658:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446870144:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166827.796685:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 16 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.796697:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.796710:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.796714:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.796749:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.796750:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1762166827.796751:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 16 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.796773:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 16 pid: 8382 timeout: 546 lvb_type: 1 00000100:00100000:3.0:1762166827.796791:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446870272:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166827.797429:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.798442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.798449:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446870016:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.798467:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446870144:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166827.798538:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.798613:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166827.798613:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.798630:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446870272:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166827.798664:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.798666:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440177152 00000100:00100000:1.0:1762166827.798696:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440177152 00000100:00100000:0.0:1762166827.798709:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440177280 00000100:00100000:0.0:1762166827.798716:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440177280 00010000:00010000:1.0:1762166827.798733:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 15 pid: 8383 timeout: 546 lvb_type: 1 00010000:00010000:0.0:1762166827.798739:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 17 pid: 9168 timeout: 546 lvb_type: 1 00000100:00100000:1.0:1762166827.798778:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 715 00000100:00100000:1.0:1762166827.798792:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440177152:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166827.798792:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 716 00000100:00100000:0.0:1762166827.798813:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440177280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166827.798818:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.798826:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166827.798839:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 15 pid: 8383 timeout: 546 lvb_type: 1 00010000:00010000:0.0:1762166827.798843:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 17 pid: 9168 timeout: 546 lvb_type: 1 00010000:00010000:1.0:1762166827.798861:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 15 pid: 8383 timeout: 546 lvb_type: 1 00010000:00010000:0.0:1762166827.798864:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 17 pid: 9168 timeout: 546 lvb_type: 1 00010000:00010000:0.0:1762166827.798892:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5ae4200/0x2f180c4effb0d3b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b814b expref: 17 pid: 9168 timeout: 546 lvb_type: 1 00010000:00010000:1.0:1762166827.798893:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf786a600/0x2f180c4effb0d3b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8152 expref: 15 pid: 8383 timeout: 546 lvb_type: 1 00010000:00010000:0.0:1762166827.798922:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.798925:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.798929:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.798931:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.798936:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.798942:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.798944:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.798964:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.798992:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.798996:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.799007:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.799016:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.799031:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.799038:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440177280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 228us (424us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166827.799043:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.799046:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.799055:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440177152:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 250us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.799072:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 716 00010000:00010000:2.0:1762166827.799089:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.799089:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 715 00010000:00010000:2.0:1762166827.799102:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.799110:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.799111:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.799119:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.799135:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166827.799144:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.799155:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.799156:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.799165:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0400 already unused, calling callback (ffffffffc0cd9320) 00000100:00100000:0.0:1762166827.799166:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440177408 00000100:00100000:0.0:1762166827.799176:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440177408 00010000:00010000:3.0:1762166827.799177:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.799198:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.799199:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 16 pid: 8382 timeout: 546 lvb_type: 1 00010000:00010000:2.0:1762166827.799200:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.799243:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.799245:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d562 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.799312:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 717 00000100:00100000:0.0:1762166827.799324:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440177408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166827.799334:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.799342:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d55b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.799350:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 16 pid: 8382 timeout: 546 lvb_type: 1 00000100:00100000:2.0:1762166827.799367:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440176896:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3130us (3317us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166827.799370:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 16 pid: 8382 timeout: 546 lvb_type: 1 00000100:00100000:2.0:1762166827.799396:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1146 00010000:00010000:0.0:1762166827.799403:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0d3a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8159 expref: 16 pid: 8382 timeout: 546 lvb_type: 1 00000100:00100000:3.0:1762166827.799412:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440176768:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3205us (3425us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166827.799422:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.799426:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166827.799430:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1145 00010000:00010000:0.0:1762166827.799431:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.799441:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.799470:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.799528:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.799537:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.799545:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440177408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 223us (418us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166827.799555:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.799555:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 717 00010000:00010000:1.0:1762166827.799566:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.799574:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.799581:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166827.799585:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.799593:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.799606:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.799614:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0d569 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.799693:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440177024:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3305us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.799701:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1147 00000100:00100000:2.0:1762166827.800409:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440176384:12345-192.168.204.38@tcp:4:dd.0 Request processed in 9166us (9312us total) trans 17179869401 rc 0/0 00000100:00100000:2.0:1762166827.800422:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 523 00002000:00100000:2.0:1762166827.800436:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x48:0x0] (0->1048575) req@ffff945bc95b1f80 x1847765440176384/t17179869401(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:613/0 lens 488/448 e 0 to 0 dl 1762166838 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166827.800446:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc95b1f80 with x1847765440176384 ext(0->1048575) 00002000:00010000:2.0:1762166827.800450:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc95b1f80 00000100:00100000:3.0:1762166827.800774:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.800820:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440177664 00000100:00100000:1.0:1762166827.800827:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440177664 00000100:00100000:1.0:1762166827.800863:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2974 00000100:00100000:1.0:1762166827.800869:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:49302:x1847765440177664:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166827.800917:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.800927:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.800933:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.800937:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.800942:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 6/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.800967:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.800978:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 36 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.801004:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446870400:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.801078:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.801089:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 36 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.801099:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446870528:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.801136:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.801146:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 36 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.801154:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446870656:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.801185:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.801811:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446870400:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.802051:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446870528:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.802065:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446870656:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.802083:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.802255:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.802296:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440178048 00000100:00100000:0.0:1762166827.802308:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440178048 00000100:00100000:3.0:1762166827.802317:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166827.802326:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 37 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:3.0:1762166827.802350:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.802364:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440177792 00000100:00100000:0.0:1762166827.802369:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440177792 00000100:00100000:1.0:1762166827.802384:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440178176 00010000:00010000:0.0:1762166827.802390:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 38 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:3.0:1762166827.802391:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 718 00000100:00100000:1.0:1762166827.802394:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440178176 00000100:00100000:3.0:1762166827.802417:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440178048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.802434:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.802445:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 39 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.802452:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 719 00010000:00010000:3.0:1762166827.802460:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 39 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.802460:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 855 00000100:00100000:2.0:1762166827.802469:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440177792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166827.802516:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44353:x1847765440178176:12345-192.168.204.38@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1762166827.802524:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.802531:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d482 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8191 expref: 39 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.802533:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 39 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.802553:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 39 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:3.0:1762166827.802576:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:3.0:1762166827.802583:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166827.802592:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166827.802597:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166827.802603:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.802612:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d554 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81c9 expref: 38 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.802626:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.802629:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.802634:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.802638:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.802641:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166827.802648:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440178048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 242us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.802658:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 718 00000100:00100000:2.0:1762166827.802665:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440177792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 200us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.802685:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 719 00000100:00100000:1.0:1762166827.802750:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:44353:x1847765440178176:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 237us (431us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1762166827.802761:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 855 00000100:00100000:3.0:1762166827.803629:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.803667:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440178304 00000100:00100000:2.0:1762166827.803683:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440178304 00010000:00010000:2.0:1762166827.803706:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 36 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.803726:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 720 00000100:00100000:2.0:1762166827.803732:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440178304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.803739:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.803743:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 36 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.803759:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 36 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.803768:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d50e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ad expref: 36 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.803776:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.803778:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.803783:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.803788:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.803809:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.803827:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.803837:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.803846:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765440178304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.803853:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 720 00000001:00080000:1.0:1762166827.804027:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967519 00000004:00010000:1.0:1762166827.804053:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aa2373ca reply state 000000009cd0e8bf transno 4294967520 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.804065:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.804072:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.804075:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:1.0:1762166827.804078:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166827.804127:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:49302:x1847765440177664:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 3257us (3353us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1762166827.804135:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2974 00000020:00080000:1.0:1762166827.804139:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166827.804902:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.804944:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440178560 00000100:00100000:1.0:1762166827.804949:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440178560 00000100:00100000:1.0:1762166827.804978:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 856 00000100:00100000:1.0:1762166827.804985:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:49302:x1847765440178560:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166827.805127:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:49302:x1847765440178560:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 142us (227us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1762166827.805142:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 856 00000100:00100000:2.0:1762166827.812372:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.812540:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440178816 00000100:00100000:1.0:1762166827.812555:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440178816 00000100:00100000:1.0:1762166827.812629:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2975 00000100:00100000:1.0:1762166827.812641:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:49303:x1847765440178816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.812747:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.812772:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d577 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81d0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.812853:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.812867:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.812878:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.812891:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.812898:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.812904:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813027:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.813035:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813057:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:1.0:1762166827.813067:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1762166827.813140:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813147:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813153:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813159:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813165:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.813169:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813175:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813185:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:1.0:1762166827.813188:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.813192:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813198:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d57e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813211:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813227:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813233:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813238:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.813241:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813246:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813253:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738400) 00010000:00010000:1.0:1762166827.813256:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.813258:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813270:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d585 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.813308:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d577 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.813320:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.813327:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.813330:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166827.813332:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29caa00, rc 0) 00000100:00100000:1.0:1762166827.813405:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:49303:x1847765440178816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 766us (1054us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1762166827.813418:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2975 00000100:00100000:0.0:1762166827.815353:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.815399:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.815437:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440178944 00000100:00100000:1.0:1762166827.815440:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440179072 00000100:00100000:3.0:1762166827.815447:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440178944 00000100:00100000:1.0:1762166827.815448:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440179072 00000100:00100000:1.0:1762166827.815523:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1148 00000100:00100000:1.0:1762166827.815535:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440179072:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166827.815540:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1149 00000100:00100000:3.0:1762166827.815554:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440178944:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166827.815587:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.815588:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.815623:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 13 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166827.815623:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 13 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.815644:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.815645:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.815649:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.815650:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.815654:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.815683:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.815713:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 13 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166827.815714:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 13 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.815738:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 13 pid: 8382 timeout: 546 lvb_type: 1 00010000:00010000:1.0:1762166827.815743:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 13 pid: 8380 timeout: 546 lvb_type: 1 00000100:00100000:3.0:1762166827.815760:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765446870784:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.815761:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446870912:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.815881:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.815881:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.816722:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446870912:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.816740:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.816891:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.816905:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765446870784:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.816921:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.816938:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440179200 00000100:00100000:2.0:1762166827.816945:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440179200 00000100:00100000:3.0:1762166827.816956:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166827.816973:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 14 pid: 8380 timeout: 546 lvb_type: 1 00000100:00100000:1.0:1762166827.817002:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440179328 00000100:00100000:2.0:1762166827.817007:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 721 00000100:00100000:1.0:1762166827.817008:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440179328 00000100:00100000:2.0:1762166827.817020:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440179200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166827.817028:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 14 pid: 8382 timeout: 546 lvb_type: 1 00010000:00010000:2.0:1762166827.817050:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166827.817063:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 722 00000100:00100000:1.0:1762166827.817073:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440179328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.817077:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 14 pid: 8380 timeout: 546 lvb_type: 1 00010000:00010000:1.0:1762166827.817084:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.817093:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 14 pid: 8380 timeout: 546 lvb_type: 1 00010000:00010000:1.0:1762166827.817100:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 14 pid: 8382 timeout: 546 lvb_type: 1 00010000:00010000:1.0:1762166827.817112:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 14 pid: 8382 timeout: 546 lvb_type: 1 00010000:00010000:2.0:1762166827.817121:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d531 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81bb expref: 14 pid: 8380 timeout: 546 lvb_type: 1 00010000:00010000:1.0:1762166827.817127:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29600/0x2f180c4effb0d52a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81b4 expref: 14 pid: 8382 timeout: 546 lvb_type: 1 00010000:00010000:2.0:1762166827.817143:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.817146:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.817148:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166827.817150:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.817155:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.817156:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.817172:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.817174:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.817209:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.817212:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166827.817225:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.817240:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817244:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817259:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.817259:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440179200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 238us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.817259:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440179328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (298us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166827.817266:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.817277:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 721 00000100:00100000:1.0:1762166827.817288:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 722 00010000:00010000:0.0:1762166827.817288:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817291:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817315:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.817315:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817325:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.817362:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.817365:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166827.817371:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817372:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817385:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.817391:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817402:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.817411:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.817413:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.817434:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0d59a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.817520:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440178944:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1969us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.817529:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1149 00000100:00100000:2.0:1762166827.817538:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440179072:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2004us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.817549:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1148 00000100:00100000:3.0:1762166827.818266:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.818301:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440179584 00000100:00100000:1.0:1762166827.818306:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440179584 00000100:00100000:1.0:1762166827.818337:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2976 00000100:00100000:1.0:1762166827.818343:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:49303:x1847765440179584:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166827.818425:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.818437:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.818442:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.818465:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.818473:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 40 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:1.0:1762166827.818529:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446871040:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.818591:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166827.819524:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446871040:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166827.819556:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.819594:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.819629:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440179712 00000100:00100000:2.0:1762166827.819635:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440179712 00010000:00010000:2.0:1762166827.819657:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 41 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.819698:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 723 00000100:00100000:2.0:1762166827.819704:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765440179712:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.819714:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.819720:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 41 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.819728:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 41 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.819747:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb0d58c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d0 expref: 41 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.819761:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.819765:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.819773:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.819781:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.819806:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.819823:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.819832:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.819847:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765440179712:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 141us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.819862:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 723 00000004:00010000:1.0:1762166827.820054:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000551319e6 reply state 00000000f505cba8 transno 4294967523 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.820074:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.820081:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.820084:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:1.0:1762166827.820087:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166827.820140:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:49303:x1847765440179584:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1796us (1874us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1762166827.820149:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2976 00000100:00100000:3.0:1762166827.820836:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.820875:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440179968 00000100:00100000:1.0:1762166827.820881:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440179968 00000100:00100000:1.0:1762166827.820917:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 857 00000100:00100000:1.0:1762166827.820926:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:49303:x1847765440179968:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166827.821097:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+42:49303:x1847765440179968:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 172us (260us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1762166827.821106:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 857 00000100:00100000:2.0:1762166827.826430:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.826524:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440180224 00000100:00100000:1.0:1762166827.826537:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440180224 00000100:00100000:1.0:1762166827.826610:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2977 00000100:00100000:1.0:1762166827.826619:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+42:49304:x1847765440180224:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:1.0:1762166827.826647:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.826667:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d5af lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81d7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.826782:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.826820:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.826833:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.826850:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.826857:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.826864:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827003:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.827009:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827014:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:1.0:1762166827.827024:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1762166827.827119:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827126:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827130:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827134:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827151:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.827158:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827166:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827180:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:1.0:1762166827.827184:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.827188:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827195:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d5b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827210:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827215:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827220:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827225:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.827228:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827233:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827239:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cd0738400) 00010000:00010000:1.0:1762166827.827242:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.827251:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827256:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d5bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.827310:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb0d5af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.827324:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.827331:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.827334:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166827.827337:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca800, rc 0) 00000100:00100000:1.0:1762166827.827403:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:49304:x1847765440180224:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 785us (989us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1762166827.827411:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2977 00000100:00100000:0.0:1762166827.829188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.829237:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440180352 00000100:00100000:2.0:1762166827.829248:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440180352 00000100:00100000:2.0:1762166827.829312:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1150 00000100:00100000:2.0:1762166827.829323:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:49304:x1847765440180352:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:2.0:1762166827.829343:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.829366:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81de expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.829394:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e:0x0] initial LVB size: 2097152, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x40 00010000:00010000:2.0:1762166827.829418:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.829421:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.829431:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 13 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.829453:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 13 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.829467:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166827.829557:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:49304:x1847765440180352:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 235us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.829565:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1150 00000100:00100000:3.0:1762166827.830651:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.830706:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440180480 00000100:00100000:2.0:1762166827.830711:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440180480 00000100:00100000:2.0:1762166827.830741:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1151 00000100:00100000:2.0:1762166827.830749:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:49304:x1847765440180480:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:2.0:1762166827.830780:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.830797:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81e5 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.830818:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 3700000, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x28 00010000:00010000:2.0:1762166827.830834:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.830836:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.830840:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 13 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.830850:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 13 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.830857:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477200, rc 0) 00000100:00100000:2.0:1762166827.830891:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:49304:x1847765440180480:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 144us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.830895:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1151 00000100:00100000:1.0:1762166827.831654:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.831705:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440180608 00000100:00100000:2.0:1762166827.831711:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440180608 00000100:00100000:2.0:1762166827.831739:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1152 00000100:00100000:2.0:1762166827.831746:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440180608:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:3.0:1762166827.831786:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.831858:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440180608:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 112us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.831865:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1152 00000100:00100000:0.0:1762166827.831875:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440180736 00000100:00100000:0.0:1762166827.831881:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440180736 00000100:00100000:0.0:1762166827.831918:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1153 00000100:00100000:0.0:1762166827.831926:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440180736:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:0.0:1762166827.831975:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440180736:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.831980:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1153 00000100:00100000:1.0:1762166827.832838:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.832906:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440180992 00000100:00100000:0.0:1762166827.832924:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440180992 00000100:00100000:0.0:1762166827.832967:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 858 00000100:00100000:0.0:1762166827.832978:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:49304:x1847765440180992:12345-192.168.204.38@tcp:35:lseek_test.0 00000100:00100000:0.0:1762166827.833242:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:49304:x1847765440180992:12345-192.168.204.38@tcp:35:lseek_test.0 Request processed in 267us (404us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1762166827.833251:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 858 00000100:00100000:1.0:1762166827.838534:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.838613:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440181248 00000100:00100000:2.0:1762166827.838628:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440181248 00000100:00100000:2.0:1762166827.838731:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2978 00000100:00100000:2.0:1762166827.838760:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:49305:x1847765440181248:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:2.0:1762166827.838788:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.838808:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d5e0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81ec expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.838919:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d5e7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.838937:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d5e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.838956:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d5e7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166827.838969:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1762166827.839090:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d5e0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ec expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.839113:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d5e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ec expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.839123:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.839125:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166827.839129:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166827.839204:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:49305:x1847765440181248:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 451us (686us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1762166827.839213:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2978 00000100:00100000:3.0:1762166827.840419:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.840515:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440181376 00000100:00100000:0.0:1762166827.840525:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440181376 00000100:00100000:0.0:1762166827.840584:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1154 00000100:00100000:0.0:1762166827.840598:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440181376:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:0.0:1762166827.840726:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440181376:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 129us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.840734:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1154 00000100:00100000:1.0:1762166827.847727:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.847780:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440181632 00000100:00100000:2.0:1762166827.847795:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440181632 00000100:00100000:2.0:1762166827.847909:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2979 00000100:00100000:2.0:1762166827.847924:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:49306:x1847765440181632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.847964:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.847994:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476e00/0x2f180c4effb0d5f5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81f3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.848156:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.848175:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.848186:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 4/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.848231:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.848250:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 48 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.848267:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446871168:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166827.848394:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166827.849459:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446871168:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166827.849518:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.849996:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.850044:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440181760 00000100:00100000:2.0:1762166827.850051:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440181760 00010000:00010000:2.0:1762166827.850084:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 49 pid: 6496 timeout: 546 lvb_type: 0 00000100:00100000:2.0:1762166827.850138:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 724 00000100:00100000:2.0:1762166827.850148:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440181760:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.850166:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.850174:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 49 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.850187:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 49 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.850212:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb0d5c4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81d7 expref: 49 pid: 6496 timeout: 546 lvb_type: 0 00010000:00010000:2.0:1762166827.850232:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.850237:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.850247:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.850256:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.850283:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.850316:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.850336:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.850337:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+48:2419:x1847765440181760:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 188us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.850366:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 724 00000004:00200000:1.0:1762166827.850381:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1762166827.850595:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476e00/0x2f180c4effb0d5f5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.850638:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.850648:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.850651:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166827.850655:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:1.0:1762166827.850758:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:49306:x1847765440181632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2838us (3046us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1762166827.850768:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2979 00000100:00100000:1.0:1762166827.852387:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.852438:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440181888 00000100:00100000:2.0:1762166827.852449:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440181888 00000100:00100000:2.0:1762166827.852574:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2980 00000100:00100000:2.0:1762166827.852584:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:49306:x1847765440181888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.852607:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.852624:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d60a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b81fa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.852714:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.852728:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.852735:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.852766:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.852778:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 49 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166827.852792:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446871296:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166827.852863:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.854011:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446871296:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.854035:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.854403:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.854463:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440182016 00000100:00100000:2.0:1762166827.854516:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440182016 00010000:00010000:2.0:1762166827.854567:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 50 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166827.854613:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 725 00000100:00100000:2.0:1762166827.854624:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440182016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.854654:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.854661:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 50 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:2.0:1762166827.854684:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 50 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:2.0:1762166827.854707:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d5fc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81f3 expref: 50 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:2.0:1762166827.854722:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.854725:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.854733:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.854738:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.854760:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.854793:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.854804:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.854806:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440182016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.854822:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 725 00000004:00200000:1.0:1762166827.854872:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:1.0:1762166827.854887:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166827.854916:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.854948:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d60a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81fa expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.854979:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81fa expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.854987:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.854990:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166827.854993:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:1.0:1762166827.855032:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:49306:x1847765440181888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2449us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.855040:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2980 00000100:00100000:1.0:1762166827.856506:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.856576:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440182272 00000100:00100000:0.0:1762166827.856585:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440182272 00000100:00100000:0.0:1762166827.856651:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 859 00000100:00100000:0.0:1762166827.856664:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+48:49306:x1847765440182272:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166827.856920:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:49306:x1847765440182272:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 260us (417us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1762166827.856930:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 859 00000100:00100000:2.0:1762166827.857984:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.858044:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440182528 00000100:00100000:1.0:1762166827.858053:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440182528 00000100:00100000:1.0:1762166827.858104:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2981 00000100:00100000:1.0:1762166827.858111:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:49306:x1847765440182528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166827.858131:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166827.858134:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166827.858170:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d5e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81ec expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.858191:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.858196:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.858212:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d618 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8201 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.858304:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d61f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166827.858332:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d61f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.858339:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d61f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:1.0:1762166827.858351:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:1.0:1762166827.858429:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb0d618 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8201 expref: 51 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.858439:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d61f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8201 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.858444:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.858446:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166827.858448:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cba00, rc 0) 00000100:00100000:1.0:1762166827.858511:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:49306:x1847765440182528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 398us (529us total) trans 4294967530 rc 0/0 00000100:00100000:1.0:1762166827.858519:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2981 00010000:00010000:1.0:1762166827.859598:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166827.859658:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.859710:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.859711:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440182656 00000100:00100000:0.0:1762166827.859720:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440182656 00000100:00100000:0.0:1762166827.859773:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440182784 00000100:00100000:0.0:1762166827.859777:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440182784 00000100:00100000:2.0:1762166827.859788:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1155 00000100:00100000:2.0:1762166827.859806:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440182656:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166827.859828:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1156 00000100:00100000:0.0:1762166827.859844:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440182784:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166827.859859:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.859907:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 13 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.859908:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.859945:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.859949:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.859953:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.859962:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 13 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.859975:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.859977:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.859981:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.859996:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 13 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.860013:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 13 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166827.860022:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 13 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.860051:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 13 pid: 8383 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166827.860054:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446871424:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.860081:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446871552:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166827.860160:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.860161:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166827.861175:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765446871424:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166827.861202:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.861254:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446871552:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166827.861273:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166827.861317:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.861320:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440182912 00000100:00100000:2.0:1762166827.861326:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440182912 00000100:00100000:1.0:1762166827.861336:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166827.861359:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 14 pid: 8383 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166827.861408:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440183040 00000100:00100000:0.0:1762166827.861417:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 726 00000100:00100000:2.0:1762166827.861421:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440183040 00000100:00100000:0.0:1762166827.861431:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440182912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166827.861441:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.861444:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 14 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166827.861461:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 14 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166827.861471:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 14 pid: 8383 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166827.861521:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 727 00010000:00010000:0.0:1762166827.861523:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0d5d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81e5 expref: 14 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166827.861544:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762166827.861546:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440183040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166827.861547:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.861554:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.861566:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.861567:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.861596:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 14 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166827.861601:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166827.861612:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.861622:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 14 pid: 8383 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166827.861657:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440182912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 225us (377us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166827.861681:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.861693:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 726 00010000:00010000:2.0:1762166827.861698:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d5d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81de expref: 14 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166827.861707:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.861721:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.861727:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.861731:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.861732:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.861739:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.861783:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.861788:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.861792:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.861825:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166827.861853:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861853:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861875:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.861878:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440183040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 338us (544us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166827.861885:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.861911:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 727 00010000:00010000:3.0:1762166827.861915:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861919:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861934:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861941:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861947:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166827.861952:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861957:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861966:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.861981:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d62d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.862028:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440182656:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2229us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166827.862036:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1155 00000100:00100000:3.0:1762166827.862045:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440182784:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2160us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.862062:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1156 00000100:00100000:1.0:1762166827.863119:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.863179:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440183296 00000100:00100000:2.0:1762166827.863188:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440183296 00000100:00100000:2.0:1762166827.863238:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2982 00000100:00100000:2.0:1762166827.863248:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:49306:x1847765440183296:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166827.863312:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.863335:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d611 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b81fa expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.863353:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.863358:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.863390:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.863404:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.863413:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000040:00080000:2.0:1762166827.863772:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 88 off9384 00000004:00080000:2.0:1762166827.863784:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 447012305618ns, next at 402887267349ns, rc = 0 00000040:00080000:2.0:1762166827.863826:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 88 off9184 00000004:00080000:2.0:1762166827.863833:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 447012354938ns, next at 405447271299ns, rc = 0 00000040:00080000:2.0:1762166827.863866:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 88 off9472 00000004:00080000:2.0:1762166827.863872:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 447012393906ns, next at 402887267349ns, rc = 0 00000040:00080000:2.0:1762166827.863892:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 88 off9272 00000004:00080000:2.0:1762166827.863898:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 447012419561ns, next at 405447271299ns, rc = 0 00000040:00080000:2.0:1762166827.863910:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 88 off9560 00000004:00080000:2.0:1762166827.863914:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 447012436316ns, next at 402887267349ns, rc = 0 00000001:00080000:0.0:1762166827.865198:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967531 is committed 00000004:00080000:0.0:1762166827.865211:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 18 committed 00000004:00080000:0.0:1762166827.865226:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 14 committed 00010000:00010000:1.0:1762166827.865236:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000004:00080000:0.0:1762166827.865246:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 17 committed 00010000:00010000:1.0:1762166827.865250:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000004:00080000:0.0:1762166827.865251:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 13 committed 00000004:00080000:0.0:1762166827.865254:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 16 committed 00010000:00010000:1.0:1762166827.865272:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865279:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.865284:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865293:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865310:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xc:0x0].0x0 (ffff945bc4034000) 00010000:00010000:1.0:1762166827.865315:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1762166827.865316:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc2d93e40 refcount 2 committed 0 result 0 batchid 11 00010000:00010000:1.0:1762166827.865320:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166827.865322:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82500 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccafbd780 00000020:00080000:0.0:1762166827.865330:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82300 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc2d93780 00010000:00010000:1.0:1762166827.865333:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb0d45f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166827.865335:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc490be00 00000020:00080000:0.0:1762166827.865343:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].10 00000100:00100000:3.0:1762166827.865351:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446871680:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166827.865368:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166827.865376:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 10 batchid updated 00010000:00010000:1.0:1762166827.865377:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865386:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865392:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.865396:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865402:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166827.865406:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 11 committed batchid 10 00000100:00100000:2.0:1762166827.865413:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446871936:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166827.865421:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166827.865424:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.865430:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.865435:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865441:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb0d46d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865454:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865461:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865468:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.865469:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166827.865472:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446872192:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166827.865510:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.865514:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865521:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.865530:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446872064:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166827.865534:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.865539:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00010000:00010000:1.0:1762166827.865542:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000004:00080000:0.0:1762166827.865546:0:7435:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945bc2d8c240 with version 19 00010000:00010000:1.0:1762166827.865548:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb0d570 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.865559:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1762166827.865559:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 10 cancel update log [0x200000401:0x2:0x0].8: rc = 0 00010000:00010000:1.0:1762166827.865566:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.865578:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446871808:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166827.865582:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865592:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865598:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.865601:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166827.865605:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 10 cancel update log [0x240000400:0x2:0x0].9: rc = 0 00010000:00010000:1.0:1762166827.865607:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.865614:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1762166827.865616:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 10 00010000:00010000:1.0:1762166827.865621:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.865625:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000004:00080000:0.0:1762166827.865627:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 19 rpc_version 19 00010000:00010000:1.0:1762166827.865628:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.865636:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb0d5a8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.865660:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166827.865662:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446871680 00000100:00100000:1.0:1762166827.865679:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446871680 00000004:00010000:2.0:1762166827.865682:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f0c5129c reply state 00000000848345d6 transno 4294967531 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000020:00100000:0.0:1762166827.865682:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1762166827.865701:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166827.865703:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc4a08380 x1847765446872448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166827.865709:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446871936 00000100:00100000:3.0:1762166827.865714:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446871936 00010000:00010000:2.0:1762166827.865719:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.865724:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166827.865726:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446872064 00000100:00100000:2.0:1762166827.865728:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166827.865731:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446872448:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166827.865733:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446872064 00000100:00100000:1.0:1762166827.865761:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446872192 00000100:00100000:3.0:1762166827.865762:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446871808 00000100:00100000:1.0:1762166827.865764:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446872192 00000100:00100000:3.0:1762166827.865767:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446871808 00000100:00100000:0.0:1762166827.865774:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166827.865788:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1762166827.865795:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166827.865799:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446871680:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166827.865806:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1762166827.865816:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446871936:12345-0@lo:2:osp-syn-1-1.0 00010000:00080000:2.0:1762166827.865948:0:6496:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762166827.865967:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49306:x1847765440183296:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2719us (2846us total) trans 4294967531 rc 0/0 00000100:00100000:2.0:1762166827.865977:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2982 00000100:00100000:1.0:1762166827.865992:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765446871936:12345-0@lo:2:osp-syn-1-1.0 Request processed in 175us (522us total) trans 17179869402 rc 0/0 00000100:00100000:3.0:1762166827.865993:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765446871680:12345-0@lo:2:osp-syn-0-1.0 Request processed in 195us (571us total) trans 21474836725 rc 0/0 00010000:00010000:2.0:1762166827.866006:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.866007:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00010000:00010000:2.0:1762166827.866023:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.866028:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00010000:00010000:2.0:1762166827.866036:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.866037:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00010000:00010000:2.0:1762166827.866047:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476000 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166827.866051:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765446872064:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166827.866053:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00010000:00010000:2.0:1762166827.866054:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.866065:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166827.866070:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446871808:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166827.866080:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.866090:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166827.866095:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.866101:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d63b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.866153:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1762166827.866158:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765446872064:12345-0@lo:2:osp-syn-0-1.0 Request processed in 108us (596us total) trans 21474836726 rc 0/0 00000100:00100000:2.0:1762166827.866168:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765446872192:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166827.866169:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1762166827.866189:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446871808:12345-0@lo:2:osp-syn-1-1.0 Request processed in 123us (528us total) trans 17179869403 rc 0/0 00000004:00080000:0.0:1762166827.866200:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3ccaa00/2, rc 0, transno 21474836726 00000100:00100000:0.0:1762166827.866210:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446872064:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166827.866230:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000004:00080000:3.0:1762166827.866259:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc0700/2, rc 0, transno 17179869403 00000100:00100000:3.0:1762166827.866264:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446871808:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166827.866265:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446872448 00000100:00100000:1.0:1762166827.866271:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446872448 00000100:00100000:2.0:1762166827.866273:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765446872192:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (660us total) trans 21474836727 rc 0/0 00000004:00080000:3.0:1762166827.866283:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3cc9c00/2, rc 0, transno 21474836727 00000100:00100000:2.0:1762166827.866284:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1762166827.866295:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446872192:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166827.866306:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd3100/2, rc 0, transno 21474836725 00000100:00100000:3.0:1762166827.866309:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446871680:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166827.866316:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1762166827.866328:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7425:x1847765446872448:12345-0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1762166827.866374:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc1f80/2, rc 0, transno 17179869402 00000100:00100000:2.0:1762166827.866381:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446871936:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166827.866458:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7425:x1847765446872448:12345-0@lo:1000:osp_up0-1.0 Request processed in 132us (681us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1762166827.866467:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1762166827.866536:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446872448:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166827.867218:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.867254:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440183424 00000100:00100000:2.0:1762166827.867260:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440183424 00000100:00100000:2.0:1762166827.867291:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2983 00000100:00100000:2.0:1762166827.867296:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:49306:x1847765440183424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.867311:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.867324:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8208 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.867364:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.867373:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.867387:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.867395:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166827.867398:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:2.0:1762166827.867430:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49306:x1847765440183424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 135us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.867435:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2983 00000100:00100000:0.0:1762166827.891222:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.891298:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440183552 00000100:00100000:2.0:1762166827.891310:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440183552 00000100:00100000:2.0:1762166827.891374:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2984 00000100:00100000:2.0:1762166827.891387:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49306:x1847765440183552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.891418:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.891454:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d649 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b820f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.891647:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d650 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.891695:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d650 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.891709:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d650 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166827.891749:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:2.0:1762166827.891755:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166827.891786:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d650 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.891819:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d649 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b820f expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.891848:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d650 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b820f expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.891880:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.891884:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166827.891890:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166827.891978:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49306:x1847765440183552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 591us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.891988:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2984 00000100:00100000:1.0:1762166827.893349:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.893381:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.893405:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440183680 00000100:00100000:2.0:1762166827.893413:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440183680 00000100:00100000:3.0:1762166827.893423:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440183808 00000100:00100000:3.0:1762166827.893434:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440183808 00000100:00100000:2.0:1762166827.893467:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1162 00000100:00100000:3.0:1762166827.893509:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1163 00000100:00100000:2.0:1762166827.893514:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440183680:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:3.0:1762166827.893522:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440183808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166827.893536:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.893537:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166827.893563:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0d65e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b821d expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.893563:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d657 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8216 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.893603:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e:0x0] initial LVB size: 2097152, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x40 00002000:00010000:3.0:1762166827.893604:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 3700000, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x28 00010000:00010000:3.0:1762166827.893630:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.893630:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.893635:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.893635:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.893650:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0d65e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b821d expref: 13 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.893651:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d657 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8216 expref: 13 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.893689:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d657 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8216 expref: 13 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166827.893693:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0d65e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b821d expref: 13 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166827.893711:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00010000:00010000:3.0:1762166827.893712:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:2.0:1762166827.893770:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2417:x1847765440183680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 293us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.893772:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440183808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 252us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.893784:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1163 00000100:00100000:2.0:1762166827.893800:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1162 00000100:00100000:0.0:1762166827.895255:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.895287:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.895313:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440183936 00000100:00100000:2.0:1762166827.895322:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440183936 00000100:00100000:3.0:1762166827.895336:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440184064 00000100:00100000:3.0:1762166827.895341:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440184064 00000100:00100000:2.0:1762166827.895371:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1164 00000100:00100000:2.0:1762166827.895382:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440183936:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.895385:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1165 00000100:00100000:3.0:1762166827.895404:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440184064:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.895515:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440184064:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 105us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.895515:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440183936:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 128us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.895525:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1165 00000100:00100000:2.0:1762166827.895533:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1164 00000100:00100000:0.0:1762166827.896902:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.896964:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440184192 00000100:00100000:2.0:1762166827.896971:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440184192 00000100:00100000:2.0:1762166827.897016:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2985 00000100:00100000:2.0:1762166827.897026:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49306:x1847765440184192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.897047:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.897071:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d665 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8224 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.897110:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d66c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.897125:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d66c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.897139:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d66c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.897251:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d665 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8224 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.897273:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d66c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8224 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.897280:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.897282:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166827.897284:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477800, rc 0) 00000100:00100000:2.0:1762166827.897322:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:49306:x1847765440184192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 299us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.897326:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2985 00000100:00100000:1.0:1762166827.898433:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.898499:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440184448 00000100:00100000:2.0:1762166827.898507:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440184448 00000100:00100000:2.0:1762166827.898557:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2986 00000100:00100000:2.0:1762166827.898572:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:49306:x1847765440184448:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166827.898624:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.898645:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d650 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b820f expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.898659:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.898663:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.898902:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.898914:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.898922:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:2.0:1762166827.898991:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967532 00000004:00010000:2.0:1762166827.899018:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000195c33fc reply state 00000000c5439889 transno 4294967533 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.899030:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.899037:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.899040:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166827.899042:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166827.899120:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:49306:x1847765440184448:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 554us (692us total) trans 4294967533 rc 0/0 00000100:00100000:2.0:1762166827.899126:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2986 00000020:00080000:2.0:1762166827.899130:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166827.900028:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.900093:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440184576 00000100:00100000:2.0:1762166827.900105:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440184576 00000100:00100000:2.0:1762166827.900156:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1166 00000100:00100000:2.0:1762166827.900165:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:49306:x1847765440184576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.900181:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.900203:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b822b expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.900229:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 1048576, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x8 00010000:00010000:2.0:1762166827.900251:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.900253:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.900263:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 14 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.900279:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 14 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.900302:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166827.900348:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:49306:x1847765440184576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 183us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.900355:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1166 00000100:00100000:0.0:1762166827.901199:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.901241:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440184704 00000100:00100000:2.0:1762166827.901246:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440184704 00000100:00100000:2.0:1762166827.901277:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1167 00000100:00100000:2.0:1762166827.901284:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:49306:x1847765440184704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.901295:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.901311:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8232 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.901330:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1d:0x0] initial LVB size: 2097152, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x20 00010000:00010000:2.0:1762166827.901342:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.901344:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.901349:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 14 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.901361:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 14 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.901370:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477000, rc 0) 00000100:00100000:2.0:1762166827.901404:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:49306:x1847765440184704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 121us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.901411:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1167 00000100:00100000:1.0:1762166827.902244:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.902291:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440184832 00000100:00100000:2.0:1762166827.902296:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440184832 00000100:00100000:2.0:1762166827.902331:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1168 00000100:00100000:2.0:1762166827.902339:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:49306:x1847765440184832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.902351:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.902365:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8239 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166827.902386:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 1602848, mtime: 0x6908882b, atime: 0x6908882b, ctime: 0x6908882b, blocks: 0x38 00010000:00010000:2.0:1762166827.902400:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.902401:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.902407:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 15 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.902419:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 15 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.902427:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166827.902463:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:49306:x1847765440184832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 126us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.902471:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1168 00000100:00100000:0.0:1762166827.903443:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.903469:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.903518:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.903531:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440184960 00000100:00100000:3.0:1762166827.903539:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440184960 00000100:00100000:2.0:1762166827.903549:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440185088 00000100:00100000:2.0:1762166827.903556:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440185088 00000100:00100000:2.0:1762166827.903571:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440185216 00000100:00100000:2.0:1762166827.903575:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440185216 00002000:00010000:3.0:1762166827.903578:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/31 (0->18446744073709551615) 00002000:00100000:3.0:1762166827.903585:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013800 with x1847765440184960 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166827.903593:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/32 (0->18446744073709551615) 00002000:00010000:3.0:1762166827.903597:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4013800. 00002000:00100000:2.0:1762166827.903599:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010380 with x1847765440185216 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166827.903607:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4010380. 00000100:00100000:3.0:1762166827.903634:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 524 00000100:00100000:3.0:1762166827.903646:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440184960:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166827.903652:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 525 00000100:00100000:2.0:1762166827.903664:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440185216:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166827.904583:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/29 (0->18446744073709551615) 00002000:00100000:0.0:1762166827.904590:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011500 with x1847765440185088 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166827.904597:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011500. 00000100:00100000:0.0:1762166827.904637:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 526 00000100:00100000:0.0:1762166827.904648:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440185088:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166827.905171:0:16567:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:3.0:1762166827.905176:0:16567:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 1762166827 -> 1762166828 00002000:00010000:3.0:1762166827.905180:0:16567:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:3.0:1762166827.905183:0:16567:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1762166827 -> 1762166828 00002000:00010000:3.0:1762166827.905186:0:16567:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1762166827.905264:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440184960:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 1620us (1822us total) trans 21474836728 rc 0/0 00000100:00100000:3.0:1762166827.905275:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 524 00002000:00010000:3.0:1762166827.905280:0:16567:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/31 (0->18446744073709551615) 00002000:00100000:3.0:1762166827.905283:0:16567:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013800 with x1847765440184960 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166827.905289:0:16567:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4013800. 00002000:00010000:2.0:1762166827.905515:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 1602848 -> 0 00002000:00010000:2.0:1762166827.905520:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime from disk: 1762166827 -> 1762166828 00002000:00010000:2.0:1762166827.905522:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.905525:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime from disk: 1762166827 -> 1762166828 00002000:00010000:2.0:1762166827.905527:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 56 -> 0 00000100:00100000:2.0:1762166827.905568:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440185216:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 1906us (2049us total) trans 21474836729 rc 0/0 00000100:00100000:2.0:1762166827.905576:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 525 00002000:00010000:2.0:1762166827.905580:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/32 (0->18446744073709551615) 00002000:00100000:2.0:1762166827.905583:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010380 with x1847765440185216 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166827.905588:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4010380. 00002000:00010000:0.0:1762166827.905813:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:0.0:1762166827.905817:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb mtime from disk: 1762166827 -> 1762166828 00002000:00010000:0.0:1762166827.905819:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:0.0:1762166827.905822:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb ctime from disk: 1762166827 -> 1762166828 00002000:00010000:0.0:1762166827.905824:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb blocks from disk: 32 -> 0 00000100:00100000:0.0:1762166827.905860:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440185088:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 1214us (2388us total) trans 17179869404 rc 0/0 00000100:00100000:0.0:1762166827.905869:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 526 00002000:00010000:0.0:1762166827.905872:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/29 (0->18446744073709551615) 00002000:00100000:0.0:1762166827.905875:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011500 with x1847765440185088 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166827.905881:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011500. 00000100:00100000:1.0:1762166827.906943:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.906999:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440185344 00000100:00100000:2.0:1762166827.907009:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440185344 00000100:00100000:2.0:1762166827.907058:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2987 00000100:00100000:2.0:1762166827.907068:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:49306:x1847765440185344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.907093:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.907115:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d68f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8240 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.907211:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0d696 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.907226:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0d696 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.907234:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0d696 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166827.907278:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 0 00000004:00200000:2.0:1762166827.907283:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166827.907303:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0d696 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.907334:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d68f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8240 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.907352:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0d696 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8240 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.907361:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.907363:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166827.907367:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166827.907407:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:49306:x1847765440185344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 343us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.907412:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2987 00000100:00100000:1.0:1762166827.909079:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.909116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.909143:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440185472 00000100:00100000:2.0:1762166827.909153:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440185472 00000100:00100000:3.0:1762166827.909161:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440185600 00000100:00100000:3.0:1762166827.909167:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440185600 00000100:00100000:2.0:1762166827.909208:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1169 00000100:00100000:2.0:1762166827.909223:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440185472:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.909228:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1170 00000100:00100000:3.0:1762166827.909241:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765440185600:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.909339:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765440185600:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.909344:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440185472:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 124us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.909349:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1170 00000100:00100000:2.0:1762166827.909359:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1169 00000100:00100000:1.0:1762166827.910562:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.910598:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.910622:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440185728 00000100:00100000:2.0:1762166827.910630:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440185728 00000100:00100000:3.0:1762166827.910640:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440185856 00000100:00100000:3.0:1762166827.910646:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440185856 00000100:00100000:2.0:1762166827.910689:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1171 00000100:00100000:3.0:1762166827.910710:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1172 00000100:00100000:2.0:1762166827.910710:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440185728:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.910729:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440185856:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166827.910819:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440185728:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.910820:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440185856:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.910836:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1171 00000100:00100000:3.0:1762166827.910844:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1172 00000100:00100000:1.0:1762166827.912699:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.912755:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440185984 00000100:00100000:0.0:1762166827.912765:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440185984 00000100:00100000:0.0:1762166827.912849:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 527 00000100:00100000:0.0:1762166827.912860:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440185984:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166827.912901:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.912919:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.912921:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.912928:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.912956:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.914136:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.914151:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.914161:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.914168:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166827.914173:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.914181:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.914200:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.914207:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0000/0x2f180c4effb0d69d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [1044480->1069055] (req 1044480->1069055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.914277:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440185984:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1417us (1585us total) trans 0 rc 24576/24576 00000100:00100000:0.0:1762166827.914300:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 527 00000100:00100000:3.0:1762166827.915936:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.915979:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440186240 00000100:00100000:0.0:1762166827.915988:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440186240 00000100:00100000:1.0:1762166827.915993:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.916040:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440186112 00000100:00100000:3.0:1762166827.916045:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440186112 00000100:00100000:0.0:1762166827.916067:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 528 00000100:00100000:0.0:1762166827.916081:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440186240:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:3.0:1762166827.916100:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 529 00000100:00100000:3.0:1762166827.916110:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440186112:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166827.916122:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.916132:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.916145:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.916150:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.916162:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.916164:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166827.916166:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.916169:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166827.916173:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.916174:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.916230:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.916231:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.916249:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 18 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166827.916258:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 18 pid: 8383 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166827.916272:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765446872704:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.916274:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765446872576:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.916380:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.916384:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166827.917305:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765446872704:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166827.917307:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765446872576:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166827.917334:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.917335:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.917576:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.917609:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.917643:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440186496 00000100:00100000:2.0:1762166827.917651:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440186496 00000100:00100000:0.0:1762166827.917680:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440186368 00000100:00100000:0.0:1762166827.917686:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440186368 00010000:00010000:2.0:1762166827.917695:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 20 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166827.917708:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 20 pid: 8383 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166827.917735:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 728 00000100:00100000:0.0:1762166827.917749:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 729 00000100:00100000:2.0:1762166827.917750:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440186496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166827.917765:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440186368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166827.917770:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.917779:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166827.917797:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 20 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:2.0:1762166827.917798:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 20 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166827.917825:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 20 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:2.0:1762166827.917827:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 20 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:2.0:1762166827.917862:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d67a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b822b expref: 20 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166827.917864:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0d688 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8239 expref: 20 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:2.0:1762166827.917892:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.917892:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.917895:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166827.917900:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.917903:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.917909:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.917914:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.917923:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.917949:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.917954:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166827.917983:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166827.917984:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.918006:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166827.918008:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440186368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 245us (395us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166827.918009:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.918012:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440186496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 264us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166827.918031:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 729 00000100:00100000:2.0:1762166827.918040:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 728 00000001:00080000:1.0:1762166827.919827:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836730 is committed 00000001:00080000:1.0:1762166827.919847:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836727 is committed 00002000:00010000:3.0:1762166827.919936:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1762166827.919941:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1762166827.919953:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.919963:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.919973:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.919981:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.919986:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.920006:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.920032:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.920043:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.920125:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440186112:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4012us (4131us total) trans 21474836730 rc 0/0 00000100:00100000:3.0:1762166827.920135:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 529 00000001:00080000:1.0:1762166827.921374:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836731 is committed 00002000:00010000:2.0:1762166827.921586:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 0 -> 20480 00002000:00010000:2.0:1762166827.921595:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:2.0:1762166827.921608:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.921620:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.921629:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.921636:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.921641:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.921650:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.921683:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.921708:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d6a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.921814:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440186240:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5733us (5882us total) trans 21474836731 rc 0/0 00000100:00100000:2.0:1762166827.921825:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 528 00000100:00100000:0.0:1762166827.923462:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.923560:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440186624 00000100:00100000:0.0:1762166827.923561:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.923572:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440186624 00000100:00100000:2.0:1762166827.923614:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440186752 00000100:00100000:2.0:1762166827.923627:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440186752 00000100:00100000:3.0:1762166827.923632:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1173 00000100:00100000:3.0:1762166827.923646:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440186624:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166827.923700:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1174 00000100:00100000:2.0:1762166827.923715:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440186752:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.923789:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440186624:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 144us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.923802:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1173 00000100:00100000:2.0:1762166827.923829:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440186752:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 116us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.923842:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1174 00000100:00100000:0.0:1762166827.925398:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.925437:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.925513:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440187008 00000100:00100000:2.0:1762166827.925522:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440187008 00000100:00100000:3.0:1762166827.925525:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440186880 00000100:00100000:3.0:1762166827.925534:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440186880 00000100:00100000:2.0:1762166827.925578:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1175 00000100:00100000:2.0:1762166827.925594:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440187008:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.925629:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1176 00000100:00100000:3.0:1762166827.925640:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440186880:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166827.925698:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440187008:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.925708:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1175 00000100:00100000:3.0:1762166827.925734:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440186880:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 95us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.925761:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1176 00000100:00100000:1.0:1762166827.927428:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.927453:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.927511:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440187136 00000100:00100000:2.0:1762166827.927522:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440187136 00000100:00100000:2.0:1762166827.927577:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440187264 00000100:00100000:2.0:1762166827.927582:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440187264 00000100:00100000:3.0:1762166827.927594:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 530 00000100:00100000:3.0:1762166827.927612:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440187136:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166827.927627:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 531 00000100:00100000:2.0:1762166827.927640:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440187264:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166827.927696:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.927716:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.927719:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.927720:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.927731:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.927741:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.927746:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.927754:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.927755:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.927800:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.927924:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.927935:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.927944:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.927952:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166827.927957:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.927973:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.928001:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.928010:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.928068:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440187136:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 463us (646us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1762166827.928076:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 530 00010000:00010000:2.0:1762166827.928440:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.928453:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.928462:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.928469:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.928473:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.928517:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.928537:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.928556:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.928657:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440187264:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1018us (1199us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1762166827.928677:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 531 00000100:00100000:1.0:1762166827.930574:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.930620:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440187392 00000100:00100000:1.0:1762166827.930623:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.930627:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440187392 00000100:00100000:3.0:1762166827.930648:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440187520 00000100:00100000:3.0:1762166827.930655:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440187520 00000100:00100000:2.0:1762166827.930698:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 532 00000100:00100000:2.0:1762166827.930710:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440187392:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:3.0:1762166827.930725:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 533 00000100:00100000:3.0:1762166827.930738:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440187520:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166827.930748:0:14623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 20480, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x28 00010000:00010000:2.0:1762166827.930757:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.930758:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.930777:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.930780:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.930781:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 15 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.930785:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.930792:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.930796:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166827.930799:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.930802:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.930827:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 15 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.930847:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 15 pid: 8383 timeout: 547 lvb_type: 0 00000100:00100000:3.0:1762166827.930858:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446872832:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166827.930920:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166827.931712:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446872832:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166827.931730:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166827.931859:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836732 is committed 00002000:00010000:2.0:1762166827.931925:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 20480 -> 1048576 00002000:00010000:2.0:1762166827.931930:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 40 -> 56 00010000:00010000:2.0:1762166827.931937:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.931970:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.931979:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166827.931984:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166827.931996:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.932000:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.932009:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.932023:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.932030:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477400/0x2f180c4effb0d6c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.932092:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440187392:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1385us (1522us total) trans 21474836732 rc 0/0 00000100:00100000:3.0:1762166827.932102:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440187648 00000100:00100000:2.0:1762166827.932102:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 532 00000100:00100000:3.0:1762166827.932108:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440187648 00010000:00010000:3.0:1762166827.932134:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 16 pid: 8383 timeout: 547 lvb_type: 0 00000100:00100000:3.0:1762166827.932172:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 730 00000100:00100000:3.0:1762166827.932181:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440187648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.932226:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.932240:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 16 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166827.932251:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 16 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166827.932266:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d681 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8232 expref: 16 pid: 8383 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166827.932281:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.932283:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.932287:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.932294:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.932315:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.932336:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.932344:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440187648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (361us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166827.932351:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.932357:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 730 00000001:00080000:3.0:1762166827.933283:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869405 is committed 00000001:00080000:3.0:1762166827.933294:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869403 is committed 00002000:00010000:2.0:1762166827.933360:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb size from disk: 0 -> 1064960 00002000:00010000:2.0:1762166827.933364:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:2.0:1762166827.933370:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.933377:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.933384:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.933390:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.933393:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.933400:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.933410:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.933417:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0d6c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.933462:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440187520:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2728us (2839us total) trans 17179869405 rc 0/0 00000100:00100000:2.0:1762166827.933470:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 533 00000100:00100000:0.0:1762166827.934897:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.934935:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440187776 00000100:00100000:3.0:1762166827.934942:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440187776 00000100:00100000:3.0:1762166827.934980:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1177 00000100:00100000:3.0:1762166827.934988:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440187776:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.935053:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440187776:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 67us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.935058:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1177 00000100:00100000:1.0:1762166827.936030:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.936075:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440187904 00000100:00100000:3.0:1762166827.936079:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440187904 00000100:00100000:3.0:1762166827.936109:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1178 00000100:00100000:3.0:1762166827.936116:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440187904:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166827.936168:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440187904:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 52us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.936183:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1178 00000100:00100000:1.0:1762166827.937664:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.937724:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440188032 00000100:00100000:2.0:1762166827.937730:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440188032 00000100:00100000:2.0:1762166827.937769:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 534 00000100:00100000:2.0:1762166827.937779:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440188032:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166827.937803:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937816:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.937819:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.937823:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937835:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937912:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937921:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937928:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937934:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.937938:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937946:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937966:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.937973:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0d6ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [3698688->3702783] (req 3698688->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.938014:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440188032:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 237us (351us total) trans 0 rc 1312/1312 00000100:00100000:2.0:1762166827.938021:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 534 00000100:00100000:0.0:1762166827.939574:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.939622:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440188160 00000100:00100000:2.0:1762166827.939629:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440188160 00000100:00100000:2.0:1762166827.939686:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 535 00000100:00100000:2.0:1762166827.939696:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440188160:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166827.939728:0:23939:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 1048576, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x38 00010000:00010000:2.0:1762166827.939736:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.939745:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.939747:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166827.939751:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.939761:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762166827.942018:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836733 is committed 00002000:00010000:2.0:1762166827.942099:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 1048576 -> 1605632 00002000:00010000:2.0:1762166827.942112:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 56 -> 64 00010000:00010000:2.0:1762166827.942121:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.942131:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.942139:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.942146:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166827.942150:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.942159:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.942174:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.942181:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [1601536->1605631] (req 1601536->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166827.942254:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440188160:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2558us (2679us total) trans 21474836733 rc 0/0 00000100:00100000:2.0:1762166827.942263:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 535 00000100:00100000:1.0:1762166827.944060:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.944112:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440188416 00000100:00100000:2.0:1762166827.944121:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440188416 00000100:00100000:2.0:1762166827.944172:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2988 00000100:00100000:2.0:1762166827.944192:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:49306:x1847765440188416:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166827.944238:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166827.944257:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0d696 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8240 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.944274:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.944278:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166827.944421:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.944435:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.944444:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000001:00080000:2.0:1762166827.944532:0:6496:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967534 00000004:00010000:2.0:1762166827.944555:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c6b510e0 reply state 0000000014104b5a transno 4294967535 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.944566:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.944572:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.944575:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166827.944578:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166827.944646:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:49306:x1847765440188416:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 455us (592us total) trans 4294967535 rc 0/0 00000100:00100000:2.0:1762166827.944652:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2988 00000020:00080000:2.0:1762166827.944657:0:6496:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166827.945658:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.945714:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440188544 00000100:00100000:3.0:1762166827.945722:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440188544 00000100:00100000:3.0:1762166827.945774:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1179 00000100:00100000:3.0:1762166827.945785:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:49306:x1847765440188544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166827.945801:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166827.945821:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8247 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166827.945843:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 1048576, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x8 00010000:00010000:3.0:1762166827.945864:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.945867:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.945876:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 11 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.945892:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 11 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.945904:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29000, rc 0) 00000100:00100000:3.0:1762166827.945948:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:49306:x1847765440188544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 166us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.945953:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1179 00000100:00100000:0.0:1762166827.946817:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.946855:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440188672 00000100:00100000:3.0:1762166827.946860:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440188672 00000100:00100000:3.0:1762166827.946885:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1180 00000100:00100000:3.0:1762166827.946889:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+9:49306:x1847765440188672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166827.946911:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166827.946922:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b824e expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166827.946936:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1d:0x0] initial LVB size: 1064960, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x20 00010000:00010000:3.0:1762166827.946945:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.946947:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.946952:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 10 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.946964:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 10 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.946973:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29a00, rc 0) 00000100:00100000:3.0:1762166827.947009:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:49306:x1847765440188672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 117us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.947016:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1180 00000100:00100000:1.0:1762166827.947746:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.947797:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440188800 00000100:00100000:3.0:1762166827.947803:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440188800 00000100:00100000:3.0:1762166827.947837:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1181 00000100:00100000:3.0:1762166827.947846:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:49306:x1847765440188800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166827.947857:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166827.947870:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8255 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166827.947885:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 1605632, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x40 00010000:00010000:3.0:1762166827.947899:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.947908:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166827.947913:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 12 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.947927:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 12 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166827.947937:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28000, rc 0) 00000100:00100000:3.0:1762166827.947974:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:49306:x1847765440188800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 129us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.947981:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1181 00000100:00100000:1.0:1762166827.948720:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.948755:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.948779:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440188928 00000100:00100000:2.0:1762166827.948790:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440188928 00000100:00100000:3.0:1762166827.948811:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440189056 00000100:00100000:3.0:1762166827.948818:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440189056 00002000:00010000:2.0:1762166827.948823:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/29 (2097152->18446744073709551615) 00002000:00100000:2.0:1762166827.948831:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558bb80 with x1847765440188928 ext(2097152->18446744073709551615) 00002000:00010000:3.0:1762166827.948835:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/32 (1602848->18446744073709551615) 00002000:00010000:2.0:1762166827.948841:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558bb80. 00002000:00100000:3.0:1762166827.948842:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765440189056 ext(1602848->18446744073709551615) 00002000:00010000:3.0:1762166827.948851:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558b800. 00000100:00100000:2.0:1762166827.948869:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 536 00000100:00100000:2.0:1762166827.948879:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440188928:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166827.948887:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 537 00000100:00100000:3.0:1762166827.948900:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440189056:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166827.949067:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb size from disk: 1064960 -> 2097152 00002000:00010000:2.0:1762166827.949072:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb mtime from disk: 1762166828 -> 1762166828 00002000:00010000:2.0:1762166827.949074:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.949077:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb ctime from disk: 1762166828 -> 1762166828 00002000:00010000:2.0:1762166827.949079:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1762166827.949121:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440188928:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 244us (402us total) trans 17179869406 rc 0/0 00000100:00100000:2.0:1762166827.949128:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 536 00002000:00010000:2.0:1762166827.949131:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/29 (2097152->18446744073709551615) 00002000:00100000:2.0:1762166827.949134:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558bb80 with x1847765440188928 ext(2097152->18446744073709551615) 00002000:00010000:2.0:1762166827.949140:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558bb80. 00002000:00010000:3.0:1762166827.949215:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 1605632 -> 1602848 00002000:00010000:3.0:1762166827.949219:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime from disk: 1762166828 -> 1762166828 00002000:00010000:3.0:1762166827.949221:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:3.0:1762166827.949223:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime from disk: 1762166828 -> 1762166828 00002000:00010000:3.0:1762166827.949225:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:3.0:1762166827.949415:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440189056:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 520us (658us total) trans 21474836734 rc 0/0 00000100:00100000:3.0:1762166827.949421:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 537 00002000:00010000:3.0:1762166827.949429:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/32 (1602848->18446744073709551615) 00002000:00100000:3.0:1762166827.949431:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765440189056 ext(1602848->18446744073709551615) 00002000:00010000:3.0:1762166827.949434:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558b800. 00000100:00100000:1.0:1762166827.957386:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166827.957458:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440189312 00000100:00100000:0.0:1762166827.957470:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440189312 00000100:00100000:0.0:1762166827.957553:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 860 00000100:00100000:0.0:1762166827.957561:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:49306:x1847765440189312:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166827.957638:0:6498:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d61f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8201 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.957717:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166827.957732:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.957743:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:0.0:1762166827.957783:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166827.957810:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 26 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166827.957823:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446872960:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166827.957932:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166827.959084:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6498:1847765446872960:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166827.959112:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:1.0:1762166827.959242:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166827.959291:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440189440 00000100:00100000:3.0:1762166827.959298:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440189440 00010000:00010000:3.0:1762166827.959367:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:3.0:1762166827.959395:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 731 00000100:00100000:3.0:1762166827.959402:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440189440:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166827.959413:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166827.959420:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166827.959429:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166827.959442:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0d642 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8208 expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166827.959456:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:3.0:1762166827.959460:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:3.0:1762166827.959466:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:3.0:1762166827.959471:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT1 00010000:00010000:3.0:1762166827.959537:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166827.959563:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166827.959576:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166827.959580:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440189440:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166827.959593:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 731 00000040:00080000:1.0:1762166827.959889:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 88 off9648 00000004:00080000:1.0:1762166827.959897:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 447108418511ns, next at 402887267349ns, rc = 0 00000040:00080000:1.0:1762166827.959927:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 88 off9360 00000004:00080000:1.0:1762166827.959930:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 447108452056ns, next at 405447271299ns, rc = 0 00000040:00080000:1.0:1762166827.959945:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 88 off9736 00000004:00080000:1.0:1762166827.959948:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 447108470058ns, next at 402887267349ns, rc = 0 00000040:00080000:1.0:1762166827.959954:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 88 off9448 00000004:00080000:1.0:1762166827.959958:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 447108480059ns, next at 405447271299ns, rc = 0 00000040:00080000:1.0:1762166827.959969:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 88 off9824 00000004:00080000:1.0:1762166827.959973:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 447108494971ns, next at 402887267349ns, rc = 0 00000001:00080000:0.0:1762166827.960905:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967536 is committed 00000004:00080000:0.0:1762166827.960912:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 21 committed 00000004:00080000:0.0:1762166827.960924:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 16 committed 00010000:00010000:1.0:1762166827.960929:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000004:00080000:0.0:1762166827.960933:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 20 committed 00010000:00010000:1.0:1762166827.960938:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000004:00080000:0.0:1762166827.960943:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 15 committed 00010000:00010000:1.0:1762166827.960945:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000004:00080000:0.0:1762166827.960949:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 19 committed 00010000:00010000:1.0:1762166827.960957:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.960962:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.960970:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166827.960972:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 11 batchid updated 00010000:00010000:1.0:1762166827.960986:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.960998:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1762166827.960998:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 11 00010000:00010000:1.0:1762166827.961005:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.961013:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb0d673 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.961031:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.961041:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.961048:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166827.961054:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166827.961058:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166827.961063:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446873088:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166827.961066:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166827.961080:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 11 cancel update log [0x240000400:0x2:0x0].10: rc = 0 00000100:00100000:2.0:1762166827.961081:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446873472:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166827.961081:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.961089:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166827.961094:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166827.961096:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 11 00010000:00010000:1.0:1762166827.961112:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477000/0x2f180c4effb0d6dc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166827.961115:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446873344:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166827.961126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166827.961141:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446873216:0@lo:2:osp-syn-1-1.0 00000004:00010000:1.0:1762166827.961165:0:6498:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b761a6ad reply state 00000000183216db transno 4294967536 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166827.961177:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446873600:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166827.961178:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166827.961183:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00010000:00010000:1.0:1762166827.961200:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.961203:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166827.961204:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446873088 00000100:00100000:1.0:1762166827.961205:0:6498:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166827.961209:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446873088 00010000:00010000:1.0:1762166827.961213:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166827.961216:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166827.961221:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb0d61f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8201 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166827.961227:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166827.961261:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446873600 00000100:00100000:0.0:1762166827.961261:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446873344 00000100:00100000:2.0:1762166827.961266:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446873600 00000100:00100000:0.0:1762166827.961268:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446873344 00000100:00100000:2.0:1762166827.961296:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00010000:00080000:1.0:1762166827.961307:0:6498:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762166827.961310:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446873088:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166827.961311:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1762166827.961323:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:49306:x1847765440189312:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3760us (3951us total) trans 4294967536 rc 0/0 00000100:00100000:3.0:1762166827.961324:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1762166827.961324:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765446873600:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166827.961338:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 860 00000100:00100000:3.0:1762166827.961352:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446873344:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166827.961449:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1762166827.961451:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 3700000 -> 3700000 00002000:00010000:2.0:1762166827.961455:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 1762166828 -> 1762166828 00002000:00010000:3.0:1762166827.961456:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1762166827.961457:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.961461:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:3.0:1762166827.961463:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb mtime from disk: 1762166827 -> 1762166827 00002000:00010000:0.0:1762166827.961465:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:3.0:1762166827.961468:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.961468:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1762166828 -> 1762166828 00002000:00010000:0.0:1762166827.961472:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.961474:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:3.0:1762166827.961498:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb ctime from disk: 1762166827 -> 1762166827 00002000:00010000:0.0:1762166827.961504:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb blocks from disk: 40 -> 40 00002000:00010000:3.0:1762166827.961505:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1e:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:2.0:1762166827.961541:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446873088:12345-0@lo:2:osp-syn-0-1.0 Request processed in 237us (421us total) trans 21474836735 rc 0/0 00000100:00100000:2.0:1762166827.961548:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1762166827.961557:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836727 gen 2 00000100:00100000:0.0:1762166827.961559:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446873600:12345-0@lo:2:osp-syn-0-1.0 Request processed in 237us (334us total) trans 21474836736 rc 0/0 00000100:00100000:3.0:1762166827.961565:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446873344:12345-0@lo:2:osp-syn-1-1.0 Request processed in 225us (389us total) trans 17179869407 rc 0/0 00000004:00080000:1.0:1762166827.961566:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836724 committed transno 21474836727 00000100:00100000:0.0:1762166827.961573:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00010000:00010000:2.0:1762166827.961576:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT1 00000100:00100000:3.0:1762166827.961583:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00010000:00010000:2.0:1762166827.961591:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT1 00000004:00080000:1.0:1762166827.961591:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd3100, transno 21474836725 00010000:00010000:2.0:1762166827.961603:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00000004:00080000:1.0:1762166827.961607:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3ccaa00, transno 21474836726 00000100:00100000:0.0:1762166827.961611:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762166827.961614:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3cc9c00, transno 21474836727 00010000:00010000:2.0:1762166827.961617:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.961622:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT1 00000100:00100000:1.0:1762166827.961626:0:3634:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf3cca680 x1847765446873088/t21474836735(21474836735) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166843 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1762166827.961632:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT1 00000004:00080000:1.0:1762166827.961646:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3cca680/2, rc 0, transno 21474836735 00000100:00100000:1.0:1762166827.961651:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446873088:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166827.961652:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.961660:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1762166827.961660:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166827.961678:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00010000:00010000:2.0:1762166827.961683:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d6f8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT1 00000004:00080000:1.0:1762166827.961688:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3cc8000/2, rc 0, transno 21474836736 00000100:00100000:1.0:1762166827.961692:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446873600:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166827.961715:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446873216 00000100:00100000:0.0:1762166827.961719:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869403 gen 2 00000100:00100000:3.0:1762166827.961720:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446873216 00000004:00080000:0.0:1762166827.961726:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869400 committed transno 17179869403 00000004:00080000:0.0:1762166827.961742:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc1f80, transno 17179869402 00000100:00100000:3.0:1762166827.961747:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446873472 00000100:00100000:3.0:1762166827.961750:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446873472 00000004:00080000:0.0:1762166827.961760:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc0700, transno 17179869403 00000100:00100000:1.0:1762166827.961765:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1762166827.961770:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5bc2a00 x1847765446873344/t17179869407(17179869407) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166843 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166827.961776:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446873216:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166827.961780:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc2a00/2, rc 0, transno 17179869407 00000100:00100000:0.0:1762166827.961787:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446873344:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166827.961850:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00002000:00010000:1.0:1762166827.961856:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1762166827.961860:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446873472:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1762166827.961868:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb mtime from disk: 1762166828 -> 1762166828 00002000:00010000:1.0:1762166827.961871:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:1.0:1762166827.961874:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb ctime from disk: 1762166828 -> 1762166828 00002000:00010000:1.0:1762166827.961876:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:1.0:1762166827.961913:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446873216:12345-0@lo:2:osp-syn-1-1.0 Request processed in 141us (308us total) trans 17179869408 rc 0/0 00000100:00100000:1.0:1762166827.961919:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00002000:00010000:2.0:1762166827.961927:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 1602848 -> 1602848 00002000:00010000:2.0:1762166827.961932:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime from disk: 1762166828 -> 1762166828 00002000:00010000:2.0:1762166827.961934:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime from disk: 1762166827 -> 1762166827 00002000:00010000:2.0:1762166827.961936:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime from disk: 1762166828 -> 1762166828 00002000:00010000:2.0:1762166827.961939:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb blocks from disk: 64 -> 64 00000004:00080000:0.0:1762166827.961941:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc1880/2, rc 0, transno 17179869408 00000100:00100000:0.0:1762166827.961948:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446873216:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166827.961976:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446873472:12345-0@lo:2:osp-syn-0-1.0 Request processed in 118us (320us total) trans 21474836737 rc 0/0 00000100:00100000:2.0:1762166827.961984:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000004:00080000:0.0:1762166827.961993:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3cc8700/2, rc 0, transno 21474836737 00000100:00100000:0.0:1762166827.961999:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446873472:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166827.962720:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.962762:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440189568 00000100:00100000:2.0:1762166827.962768:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440189568 00000100:00100000:2.0:1762166827.962806:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2989 00000100:00100000:2.0:1762166827.962815:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:49306:x1847765440189568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.962833:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.962850:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b825c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.962901:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.962913:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.962933:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.962936:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166827.962947:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166827.962986:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49306:x1847765440189568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 173us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.962993:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2989 00000100:00100000:2.0:1762166827.963956:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.963988:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440189824 00000100:00100000:1.0:1762166827.963992:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440189824 00000100:00100000:1.0:1762166827.964016:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 861 00000100:00100000:1.0:1762166827.964022:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:49306:x1847765440189824:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166827.964186:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:49306:x1847765440189824:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 162us (228us total) trans 4294967537 rc 0/0 00000100:00100000:1.0:1762166827.964194:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 861 00000100:00100000:0.0:1762166827.972719:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.972782:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440190080 00000100:00100000:2.0:1762166827.972793:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440190080 00000100:00100000:2.0:1762166827.972857:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2990 00000100:00100000:2.0:1762166827.972866:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49307:x1847765440190080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.972892:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.972917:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d706 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8263 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.972990:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.973003:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973012:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973023:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.973029:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973035:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973130:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973152:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973156:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973160:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973164:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.973167:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973172:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973182:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.973184:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.973188:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973192:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477400/0x2f180c4effb0d70d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973203:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973206:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973209:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973212:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.973217:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973221:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973225:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cc7dfdc00) 00010000:00010000:2.0:1762166827.973226:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.973228:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973231:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0d714 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.973258:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d706 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8263 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.973264:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.973265:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166827.973267:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb0d706 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8263 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.973273:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166827.973328:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49307:x1847765440190080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 465us (620us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166827.973334:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2990 00000100:00100000:0.0:1762166827.974257:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.974301:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440190336 00000100:00100000:2.0:1762166827.974307:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440190336 00000100:00100000:2.0:1762166827.974342:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2991 00000100:00100000:2.0:1762166827.974351:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49307:x1847765440190336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.974372:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.974385:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d71b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b826a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762166827.974471:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1762166827.974605:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d71b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b826a expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.974616:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cc7dfd300) 00010000:00010000:2.0:1762166827.974619:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166827.974624:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d71b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b826a expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.974636:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166827.974682:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:49307:x1847765440190336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 332us (425us total) trans 4294967538 rc 301/301 00000100:00100000:2.0:1762166827.974689:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2991 00000100:00100000:0.0:1762166827.975352:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.975390:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440190464 00000100:00100000:2.0:1762166827.975396:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440190464 00000100:00100000:2.0:1762166827.975427:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2992 00000100:00100000:2.0:1762166827.975436:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:49307:x1847765440190464:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166827.975469:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.975492:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975498:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975513:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.975517:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975521:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975551:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.975556:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975559:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166827.975581:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:2.0:1762166827.975584:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166827.975590:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975598:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975602:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975605:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975608:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975618:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.975621:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975625:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975630:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.975632:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.975634:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975638:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d729 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975644:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975647:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975650:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975653:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.975655:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975657:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975661:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cc7dfd900) 00010000:00010000:2.0:1762166827.975662:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.975682:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975686:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d730 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975694:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975697:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975701:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975704:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.975705:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975708:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975712:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.975713:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.975715:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.975718:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d737 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166827.975756:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:49307:x1847765440190464:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 322us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166827.975761:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2992 00000100:00100000:0.0:1762166827.976734:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166827.976790:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440190720 00000100:00100000:1.0:1762166827.976797:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440190720 00000100:00100000:1.0:1762166827.976836:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 862 00000100:00100000:1.0:1762166827.976847:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:49307:x1847765440190720:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166827.976993:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:49307:x1847765440190720:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 148us (259us total) trans 4294967539 rc 0/0 00000100:00100000:1.0:1762166827.977002:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 862 00000100:00100000:0.0:1762166827.985988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166827.986054:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440190976 00000100:00100000:2.0:1762166827.986083:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440190976 00000100:00100000:2.0:1762166827.986162:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2993 00000100:00100000:2.0:1762166827.986172:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:49311:x1847765440190976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166827.986199:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166827.986220:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d73e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8271 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.986310:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.986328:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986338:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986351:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.986358:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986365:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986521:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166827.986530:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986537:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166827.986558:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1762166827.986655:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986663:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986681:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986688:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986694:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.986699:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986706:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986720:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166827.986723:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.986727:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986733:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477200/0x2f180c4effb0d745 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986749:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986752:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986763:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986766:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166827.986768:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986771:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986775:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cc7dfd900) 00010000:00010000:2.0:1762166827.986776:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166827.986778:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986781:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb0d74c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166827.986819:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb0d73e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.986829:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166827.986834:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166827.986835:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166827.986837:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166827.986901:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:49311:x1847765440190976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 732us (930us total) trans 4294967540 rc 0/0 00000100:00100000:2.0:1762166827.986907:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2993 00000100:00100000:0.0:1762166828.010417:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.010455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.010544:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440191104 00000100:00100000:2.0:1762166828.010557:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440191104 00000100:00100000:0.0:1762166828.010576:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440191232 00000100:00100000:0.0:1762166828.010582:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440191232 00000100:00100000:2.0:1762166828.010648:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 538 00000100:00100000:0.0:1762166828.010658:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 539 00000100:00100000:2.0:1762166828.010662:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765440191104:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166828.010707:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765440191232:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166828.010714:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.010727:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.010737:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 14 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.010739:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 14 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.010756:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166828.010758:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166828.010759:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166828.010763:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166828.010764:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.010769:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166828.010770:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.010808:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440191360 00010000:00010000:0.0:1762166828.010812:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 14 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.010813:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 14 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.010814:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440191360 00010000:00010000:0.0:1762166828.010835:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 14 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:2.0:1762166828.010837:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 14 pid: 8382 timeout: 547 lvb_type: 0 00000100:00100000:3.0:1762166828.010851:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 540 00000100:00100000:0.0:1762166828.010861:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765446873856:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166828.010863:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440191360:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166828.010864:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765446873728:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166828.010889:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.010899:0:16567:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 11 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.010905:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166828.010906:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166828.010909:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.010927:0:16567:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 11 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.010934:0:16567:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 11 pid: 8382 timeout: 547 lvb_type: 0 00000100:00100000:3.0:1762166828.010945:0:16567:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16567:1847765446873984:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166828.010973:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166828.010973:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166828.010980:0:16567:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166828.011203:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166828.011234:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440191488 00000100:00100000:1.0:1762166828.011238:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440191488 00000100:00100000:1.0:1762166828.011269:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 541 00000100:00100000:1.0:1762166828.011281:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440191488:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166828.011297:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.011305:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166828.011306:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166828.011308:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.011314:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166828.011851:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765446873856:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166828.011857:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765446873728:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166828.011873:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.011878:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.011883:0:16567:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16567:1847765446873984:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166828.011906:0:16567:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166828.012039:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166828.012069:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.012102:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440191744 00000100:00100000:1.0:1762166828.012105:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.012108:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440191744 00000100:00100000:0.0:1762166828.012129:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440191872 00010000:00010000:3.0:1762166828.012134:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 16 pid: 8382 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.012136:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440191872 00010000:00010000:0.0:1762166828.012167:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 12 pid: 8382 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166828.012173:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440191616 00000100:00100000:3.0:1762166828.012181:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 732 00000100:00100000:2.0:1762166828.012183:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440191616 00000100:00100000:3.0:1762166828.012195:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440191744:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166828.012203:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 17 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.012209:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166828.012210:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 733 00000100:00100000:1.0:1762166828.012222:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440191872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166828.012230:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166828.012232:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 734 00010000:00010000:3.0:1762166828.012234:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 17 pid: 8382 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.012244:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440191616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166828.012245:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 12 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.012248:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 17 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166828.012260:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166828.012270:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 12 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166828.012277:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 17 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.012283:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0d6f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8255 expref: 17 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:1.0:1762166828.012287:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0d6ea lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b824e expref: 12 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166828.012298:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 17 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.012309:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.012311:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.012315:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.012318:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0d6e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8247 expref: 16 pid: 8382 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.012337:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.012339:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.012341:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166828.012344:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.012344:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.012348:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.012350:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.012352:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.012353:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.012353:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.012373:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.012382:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.012382:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.012395:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166828.012410:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166828.012417:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.012421:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166828.012429:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166828.012433:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440191616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 192us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166828.012441:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440191872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 220us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.012443:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 734 00000100:00100000:3.0:1762166828.012447:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440191744:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 254us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166828.012460:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 733 00000100:00100000:3.0:1762166828.012467:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 732 00010000:00010000:0.0:1762166828.012472:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.012519:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.012520:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.012537:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.013999:0:16567:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.014010:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.015889:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.015908:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.015918:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.015925:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166828.015930:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.015940:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.015960:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.015966:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc29cb600/0x2f180c4effb0d776 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166828.016047:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440191488:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 4759us (4837us total) trans 0 rc 554272/554272 00000100:00100000:0.0:1762166828.016068:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 541 00010000:00010000:0.0:1762166828.017185:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.017201:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.017210:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.017219:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166828.017225:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.017233:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.017252:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.017260:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d768 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166828.017333:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2417:x1847765440191232:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 6627us (6875us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1762166828.017342:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 539 00010000:00010000:3.0:1762166828.018335:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.018349:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.018357:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.018736:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166828.018740:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.018751:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.018763:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.018832:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476400/0x2f180c4effb0d761 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.018947:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440191104:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 8287us (8541us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166828.018954:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 538 00010000:00010000:3.0:1762166828.019546:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.019554:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.019559:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.019562:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166828.019564:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.019568:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.019585:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.019590:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d76f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.019633:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440191360:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 8773us (8869us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1762166828.019640:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 540 00000100:00100000:1.0:1762166828.032952:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166828.033013:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.033058:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440192000 00000100:00100000:2.0:1762166828.033073:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440192000 00000100:00100000:3.0:1762166828.033084:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440192128 00000100:00100000:3.0:1762166828.033091:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440192128 00000100:00100000:2.0:1762166828.033155:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1187 00000100:00100000:3.0:1762166828.033169:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1188 00000100:00100000:2.0:1762166828.033176:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440192000:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:3.0:1762166828.033185:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440192128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166828.033205:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166828.033205:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166828.033237:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b827f expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.033237:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8278 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166828.033271:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166828.033286:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 1048576, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x8 00002000:00010000:3.0:1762166828.033287:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1d:0x0] initial LVB size: 2097152, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x20 00010000:00010000:3.0:1762166828.033315:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166828.033315:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.033319:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166828.033319:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166828.033333:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 12 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166828.033334:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 11 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166828.033358:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 12 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166828.033359:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 11 pid: 9165 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166828.033360:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440192256 00000100:00100000:0.0:1762166828.033375:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440192256 00010000:00010000:2.0:1762166828.033382:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad200, rc 0) 00010000:00010000:3.0:1762166828.033408:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28e00, rc 0) 00000100:00100000:3.0:1762166828.033461:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440192128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 275us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166828.033461:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440192000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 285us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.033474:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1189 00000100:00100000:3.0:1762166828.033531:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1188 00000100:00100000:0.0:1762166828.033531:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440192256:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:2.0:1762166828.033548:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1187 00010000:00010000:0.0:1762166828.033554:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166828.033577:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8286 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166828.033598:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 1602848, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x40 00010000:00010000:0.0:1762166828.033613:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.033615:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.033622:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 13 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.033636:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 13 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.033649:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:0.0:1762166828.033716:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440192256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 198us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.033724:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1189 00000100:00100000:1.0:1762166828.039603:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.039695:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440192512 00000100:00100000:2.0:1762166828.039707:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440192512 00000100:00100000:2.0:1762166828.039770:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 863 00000100:00100000:2.0:1762166828.039782:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:49311:x1847765440192512:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166828.040083:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:49311:x1847765440192512:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 303us (489us total) trans 4294967541 rc 0/0 00000100:00100000:2.0:1762166828.040093:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 863 00000100:00100000:1.0:1762166828.049720:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.049795:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440192768 00000100:00100000:2.0:1762166828.049809:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440192768 00000100:00100000:2.0:1762166828.049888:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2994 00000100:00100000:2.0:1762166828.049901:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:49314:x1847765440192768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166828.049934:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166828.049965:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effb0d792 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b828d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.050105:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166828.050123:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.050135:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166828.050148:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1762166828.050269:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effb0d792 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.050314:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.050324:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166828.050327:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166828.050332:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac600, rc 0) 00000100:00100000:2.0:1762166828.050402:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:49314:x1847765440192768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 504us (696us total) trans 4294967542 rc 0/0 00000100:00100000:2.0:1762166828.050410:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2994 00000100:00100000:1.0:1762166828.074810:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.074896:0:16567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440192896 00000100:00100000:3.0:1762166828.074911:0:16567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440192896 00000100:00100000:3.0:1762166828.075008:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 542 00000100:00100000:3.0:1762166828.075133:0:16567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440192896:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166828.075182:0:16567:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166828.075213:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.075256:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440193024 00000100:00100000:2.0:1762166828.075261:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440193024 00010000:00010000:3.0:1762166828.075281:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.075285:0:16567:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.075293:0:16567:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166828.075300:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 543 00000100:00100000:2.0:1762166828.075309:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440193024:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166828.075326:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.075328:0:16567:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.075339:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166828.075343:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166828.075348:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.075361:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.081119:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.081158:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.081166:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.081172:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166828.081176:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.081183:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.081201:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.081206:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [2097152->3702783] (req 2097152->3702783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166828.081306:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440193024:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 5990us (6087us total) trans 0 rc 1602848/1602848 00000100:00100000:2.0:1762166828.081319:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 543 00010000:00010000:3.0:1762166828.081843:0:16567:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.081853:0:16567:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.081858:0:16567:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.081871:0:16567:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166828.081874:0:16567:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.081879:0:16567:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.081887:0:16567:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.081891:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16567 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.081929:0:16567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440192896:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 6911us (7132us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1762166828.081934:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 542 00000100:00100000:1.0:1762166828.109005:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.109080:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440193280 00000100:00100000:2.0:1762166828.109093:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440193280 00000100:00100000:2.0:1762166828.109175:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2995 00000100:00100000:2.0:1762166828.109186:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:49316:x1847765440193280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166828.109234:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166828.109261:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7b5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8294 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.109386:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166828.109401:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.109407:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 4/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.109439:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.109450:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 28 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166828.109462:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446874112:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166828.109608:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166828.110527:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446874112:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166828.110548:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166828.110743:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.110785:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440193408 00000100:00100000:3.0:1762166828.110792:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440193408 00010000:00010000:3.0:1762166828.110815:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 29 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:3.0:1762166828.110846:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 735 00000100:00100000:3.0:1762166828.110854:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440193408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166828.110867:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166828.110876:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 29 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.110903:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 29 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.110920:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb0d753 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8271 expref: 29 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.110934:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:3.0:1762166828.110938:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166828.110944:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166828.110952:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166828.110975:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166828.110995:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.111002:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166828.111023:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440193408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 168us (279us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166828.111025:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000100:00100000:3.0:1762166828.111036:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 735 00010000:00010000:0.0:1762166828.111176:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effb0d7b5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.111192:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.111205:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166828.111208:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166828.111211:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cadc00, rc 0) 00000100:00100000:0.0:1762166828.111250:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:49316:x1847765440193280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2066us (2261us total) trans 4294967543 rc 0/0 00000100:00100000:0.0:1762166828.111255:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2995 00000100:00100000:1.0:1762166828.112306:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.112349:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440193536 00000100:00100000:0.0:1762166828.112355:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440193536 00000100:00100000:0.0:1762166828.112388:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2996 00000100:00100000:0.0:1762166828.112396:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:49316:x1847765440193536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166828.112415:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166828.112430:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d7ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b829b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.112540:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166828.112552:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.112559:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.112604:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.112617:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 29 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.112631:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446874240:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166828.112701:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166828.113349:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446874240:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166828.113373:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166828.113607:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.113645:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440193664 00000100:00100000:3.0:1762166828.113651:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440193664 00010000:00010000:3.0:1762166828.113680:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 30 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:3.0:1762166828.113702:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 736 00000100:00100000:3.0:1762166828.113708:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440193664:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166828.113715:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166828.113725:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 30 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.113733:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 30 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.113748:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d7bc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8294 expref: 30 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:3.0:1762166828.113758:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:3.0:1762166828.113761:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166828.113767:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166828.113771:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166828.113785:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166828.113803:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.113810:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166828.113813:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765440193664:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 105us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166828.113832:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 736 00000004:00200000:0.0:1762166828.113866:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00000004:00200000:0.0:1762166828.113873:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166828.113893:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.113920:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d7ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.113935:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.113952:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166828.113955:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166828.113958:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:0.0:1762166828.113993:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:49316:x1847765440193536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1597us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.114001:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2996 00000100:00100000:1.0:1762166828.114857:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166828.114885:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.114902:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440193792 00000100:00100000:0.0:1762166828.114907:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440193792 00000100:00100000:1.0:1762166828.114910:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.114948:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440193920 00000100:00100000:0.0:1762166828.114949:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440194048 00000100:00100000:3.0:1762166828.114954:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440193920 00000100:00100000:0.0:1762166828.114955:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440194048 00000100:00100000:2.0:1762166828.114963:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1190 00000100:00100000:2.0:1762166828.114977:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440193792:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166828.114990:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1191 00000100:00100000:0.0:1762166828.115001:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440194048:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166828.115004:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1192 00010000:00010000:2.0:1762166828.115015:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.115027:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440193920:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166828.115029:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.115034:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 14 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.115058:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 14 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166828.115062:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.115085:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.115085:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166828.115090:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.115091:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 11 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.115091:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.115096:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.115104:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.115120:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.115123:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.115126:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.115148:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 14 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.115148:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 14 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166828.115153:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 11 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.115176:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 14 pid: 9168 timeout: 547 lvb_type: 1 00010000:00010000:2.0:1762166828.115181:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 14 pid: 8382 timeout: 547 lvb_type: 1 00010000:00010000:3.0:1762166828.115182:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 11 pid: 9165 timeout: 547 lvb_type: 1 00000100:00100000:0.0:1762166828.115218:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446874368:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166828.115219:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446874624:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166828.115220:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446874496:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166828.115290:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166828.115291:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166828.115292:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166828.116199:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446874368:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166828.116220:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.116222:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3ccb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446874496:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166828.116257:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446874624:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166828.116263:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166828.116282:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166828.116307:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440194304 00000100:00100000:2.0:1762166828.116308:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.116315:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440194304 00010000:00010000:0.0:1762166828.116336:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 15 pid: 8382 timeout: 547 lvb_type: 1 00000100:00100000:1.0:1762166828.116351:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440194432 00000100:00100000:1.0:1762166828.116356:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440194432 00000100:00100000:0.0:1762166828.116361:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 737 00000100:00100000:0.0:1762166828.116369:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765440194304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166828.116377:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 16 pid: 9168 timeout: 547 lvb_type: 1 00010000:00010000:3.0:1762166828.116378:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.116379:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166828.116401:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 16 pid: 8382 timeout: 547 lvb_type: 1 00010000:00010000:0.0:1762166828.116411:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 16 pid: 8382 timeout: 547 lvb_type: 1 00000100:00100000:1.0:1762166828.116419:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 738 00000100:00100000:1.0:1762166828.116432:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440194432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166828.116437:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0d784 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8278 expref: 16 pid: 8382 timeout: 547 lvb_type: 1 00000100:00100000:2.0:1762166828.116439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166828.116443:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166828.116456:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 15 pid: 9168 timeout: 547 lvb_type: 1 00010000:00010000:0.0:1762166828.116459:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166828.116465:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 15 pid: 9168 timeout: 547 lvb_type: 1 00010000:00010000:0.0:1762166828.116470:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166828.116504:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d78b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8286 expref: 15 pid: 9168 timeout: 547 lvb_type: 1 00010000:00010000:0.0:1762166828.116506:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.116524:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.116528:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166828.116532:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166828.116536:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.116537:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440194176 00000100:00100000:3.0:1762166828.116544:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440194176 00010000:00010000:0.0:1762166828.116546:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166828.116551:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.116567:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 12 pid: 9165 timeout: 547 lvb_type: 1 00000100:00100000:0.0:1762166828.116579:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765440194304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 207us (314us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166828.116580:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.116584:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166828.116593:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.116603:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 739 00000100:00100000:1.0:1762166828.116610:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440194432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.116614:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 737 00000100:00100000:3.0:1762166828.116617:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440194176:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166828.116625:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166828.116629:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 738 00010000:00010000:3.0:1762166828.116630:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166828.116642:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.116651:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 12 pid: 9165 timeout: 547 lvb_type: 1 00010000:00010000:1.0:1762166828.116656:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.116679:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 12 pid: 9165 timeout: 547 lvb_type: 1 00010000:00010000:2.0:1762166828.116687:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.116691:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.116705:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d77d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b827f expref: 12 pid: 9165 timeout: 547 lvb_type: 1 00010000:00010000:2.0:1762166828.116711:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166828.116717:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166828.116718:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.116719:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.116720:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166828.116725:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.116741:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.116746:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.116749:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.116749:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166828.116765:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166828.116768:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166828.116772:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.116779:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.116783:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166828.116788:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440194176:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 175us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166828.116805:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 739 00010000:00010000:2.0:1762166828.116807:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.116814:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166828.116820:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d7df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.116849:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.116860:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166828.116869:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440193792:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1894us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166828.116873:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440194048:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1872us (1959us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166828.116875:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166828.116885:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1190 00010000:00010000:0.0:1762166828.116892:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166828.116897:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1191 00010000:00010000:0.0:1762166828.116901:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.116906:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166828.116909:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.116923:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.116933:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.116938:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0d7e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166828.116969:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440193920:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1955us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.116974:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1192 00000100:00100000:2.0:1762166828.117737:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.117778:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440194688 00000100:00100000:0.0:1762166828.117784:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440194688 00000100:00100000:0.0:1762166828.117819:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2997 00000100:00100000:0.0:1762166828.117827:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:49316:x1847765440194688:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166828.117873:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166828.117889:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477800/0x2f180c4effb0d66c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8224 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.117903:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166828.117907:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166828.117925:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166828.117937:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.117953:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.117961:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.117968:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 6/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.118001:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.118013:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.118026:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446874752:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166828.118085:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.118092:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.118099:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446874880:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166828.118121:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.118128:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.118140:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446875008:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166828.118162:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166828.118744:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446874752:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166828.118874:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.118882:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446874880:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166828.118903:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446875008:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166828.118924:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166828.118929:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440194944 00000100:00100000:3.0:1762166828.118934:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440194944 00000100:00100000:3.0:1762166828.118962:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 864 00000100:00100000:3.0:1762166828.118967:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:39132:x1847765440194944:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166828.119114:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.119163:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440195200 00000100:00100000:0.0:1762166828.119168:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440195200 00010000:00010000:0.0:1762166828.119186:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 30 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:2.0:1762166828.119206:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.119218:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440195072 00000100:00100000:0.0:1762166828.119223:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440195072 00010000:00010000:0.0:1762166828.119238:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 31 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:1.0:1762166828.119243:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 740 00000100:00100000:1.0:1762166828.119256:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440195200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166828.119266:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166828.119272:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 31 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.119279:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 741 00010000:00010000:1.0:1762166828.119290:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 31 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.119294:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440195072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166828.119308:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166828.119318:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0d6ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b825c expref: 31 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166828.119319:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 31 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:3.0:1762166828.119325:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:39132:x1847765440194944:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 354us (451us total) trans 4294967544 rc 0/0 00000100:00100000:3.0:1762166828.119341:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 864 00010000:00010000:0.0:1762166828.119346:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 30 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:1.0:1762166828.119359:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166828.119364:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166828.119381:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166828.119387:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166828.119393:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166828.119400:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d7d1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b829b expref: 29 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166828.119409:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166828.119418:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.119424:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166828.119427:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440195200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (310us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166828.119437:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166828.119444:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 740 00010000:00010000:0.0:1762166828.119449:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166828.119514:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440195072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 225us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.119522:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 741 00000100:00100000:2.0:1762166828.119896:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.119928:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440195328 00000100:00100000:0.0:1762166828.119933:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440195328 00010000:00010000:0.0:1762166828.119948:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1762166828.119971:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 742 00000100:00100000:0.0:1762166828.119978:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440195328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166828.119986:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166828.119991:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166828.119998:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166828.120006:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d799 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b828d expref: 27 pid: 6496 timeout: 547 lvb_type: 0 00010000:00010000:0.0:1762166828.120021:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:0.0:1762166828.120023:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: --/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.120029:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.120032:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166828.120048:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166828.120064:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166828.120071:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440195328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 93us (174us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166828.120073:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166828.120080:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 742 00000004:00010000:2.0:1762166828.120219:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000701a1707 reply state 00000000ff8fafe1 transno 4294967545 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.120229:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0d7ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x9:0x0].0x0 bits 0x2a/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.120233:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166828.120236:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2a 00000100:00100000:2.0:1762166828.120238:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166828.120274:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:49316:x1847765440194688:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2449us (2539us total) trans 4294967545 rc 0/0 00000100:00100000:2.0:1762166828.120282:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2997 00000100:00100000:2.0:1762166828.120828:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.120853:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440195584 00000100:00100000:3.0:1762166828.120858:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440195584 00000100:00100000:3.0:1762166828.120889:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 865 00000100:00100000:3.0:1762166828.120897:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:49316:x1847765440195584:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166828.121008:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:49316:x1847765440195584:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 111us (179us total) trans 4294967546 rc 0/0 00000100:00100000:3.0:1762166828.121017:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 865 00000100:00100000:1.0:1762166828.126734:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.126805:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440195840 00000100:00100000:2.0:1762166828.126817:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440195840 00000100:00100000:2.0:1762166828.126887:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2998 00000100:00100000:2.0:1762166828.126897:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:49317:x1847765440195840:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:2.0:1762166828.126925:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166828.126949:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82a2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.127053:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166828.127095:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127108:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127126:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166828.127131:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127136:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127286:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d809 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166828.127296:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d809 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127303:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d809 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166828.127317:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1762166828.127424:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127432:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127438:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127445:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127458:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166828.127463:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127472:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127521:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:2.0:1762166828.127524:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166828.127530:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127537:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d7fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127554:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127560:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127566:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127572:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166828.127574:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127580:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127587:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x5675640f (ffff945cc7dfd900) 00010000:00010000:2.0:1762166828.127590:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166828.127599:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127605:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d802 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x5675640f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.127657:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac800/0x2f180c4effb0d7f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82a2 expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.127689:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d809 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82a2 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.127697:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166828.127699:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166828.127702:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cadc00, rc 0) 00000100:00100000:2.0:1762166828.127781:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:49317:x1847765440195840:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 886us (1067us total) trans 4294967547 rc 0/0 00000100:00100000:2.0:1762166828.127790:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2998 00000100:00100000:2.0:1762166828.129227:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.129289:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440195968 00000100:00100000:0.0:1762166828.129302:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440195968 00000100:00100000:0.0:1762166828.129357:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1193 00000100:00100000:0.0:1762166828.129368:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:49317:x1847765440195968:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:0.0:1762166828.129385:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166828.129406:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d817 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82a9 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166828.129433:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 1048576, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x8 00010000:00010000:0.0:1762166828.129454:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.129456:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.129464:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82a9 expref: 12 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.129534:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82a9 expref: 12 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.129547:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:0.0:1762166828.129606:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:49317:x1847765440195968:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 240us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.129612:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1193 00000100:00100000:1.0:1762166828.130430:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.130460:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440196096 00000100:00100000:0.0:1762166828.130465:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440196096 00000100:00100000:0.0:1762166828.130507:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1194 00000100:00100000:0.0:1762166828.130515:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:49317:x1847765440196096:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:0.0:1762166828.130525:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166828.130538:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d81e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82b0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166828.130552:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1d:0x0] initial LVB size: 2097152, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x20 00010000:00010000:0.0:1762166828.130561:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.130563:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.130567:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d81e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82b0 expref: 11 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.130576:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d81e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82b0 expref: 11 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.130585:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0400, rc 0) 00000100:00100000:0.0:1762166828.130627:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:49317:x1847765440196096:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 114us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.130635:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1194 00000100:00100000:1.0:1762166828.131391:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.131428:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440196224 00000100:00100000:0.0:1762166828.131432:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440196224 00000100:00100000:0.0:1762166828.131456:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1195 00000100:00100000:0.0:1762166828.131461:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:49317:x1847765440196224:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:0.0:1762166828.131469:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166828.131506:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d825 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82b7 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166828.131517:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 1602848, mtime: 0x6908882c, atime: 0x6908882b, ctime: 0x6908882c, blocks: 0x40 00010000:00010000:0.0:1762166828.131526:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.131528:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166828.131531:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82b7 expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.131538:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82b7 expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.131544:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0200, rc 0) 00000100:00100000:0.0:1762166828.131569:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:49317:x1847765440196224:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 108us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.131573:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1195 00000100:00100000:2.0:1762166828.132291:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.132312:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.132326:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440196352 00000100:00100000:0.0:1762166828.132331:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440196352 00000100:00100000:2.0:1762166828.132337:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.132367:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440196480 00000100:00100000:1.0:1762166828.132371:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440196608 00000100:00100000:1.0:1762166828.132376:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440196608 00000100:00100000:0.0:1762166828.132378:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440196480 00000100:00100000:2.0:1762166828.132392:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1196 00000100:00100000:2.0:1762166828.132404:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440196352:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:3.0:1762166828.132412:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1197 00000100:00100000:0.0:1762166828.132421:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1198 00000100:00100000:3.0:1762166828.132428:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440196480:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:0.0:1762166828.132433:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440196608:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:0.0:1762166828.132527:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440196608:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 96us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166828.132528:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440196352:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 125us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166828.132530:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440196480:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 107us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.132547:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1198 00000100:00100000:2.0:1762166828.132558:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1196 00000100:00100000:3.0:1762166828.132565:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1197 00000100:00100000:1.0:1762166828.133579:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166828.133632:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440196864 00000100:00100000:3.0:1762166828.133638:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440196864 00000100:00100000:3.0:1762166828.133679:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 866 00000100:00100000:3.0:1762166828.133685:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:49317:x1847765440196864:12345-192.168.204.38@tcp:35:lseek_test.0 00000100:00100000:3.0:1762166828.133913:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:49317:x1847765440196864:12345-192.168.204.38@tcp:35:lseek_test.0 Request processed in 226us (335us total) trans 4294967548 rc 0/0 00000100:00100000:3.0:1762166828.133921:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 866 00000100:00100000:1.0:1762166828.138551:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166828.138602:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440197120 00000100:00100000:2.0:1762166828.138628:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440197120 00000100:00100000:2.0:1762166828.138701:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2999 00000100:00100000:2.0:1762166828.138710:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:49318:x1847765440197120:12345-192.168.204.38@tcp:101:lseek_test.0 00010000:00010000:2.0:1762166828.138731:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166828.138750:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d82c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82be expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.138855:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d833 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166828.138875:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d833 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166828.138888:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d833 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166828.138900:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x9:0x0]: returning size 3700000 00010000:00010000:2.0:1762166828.139019:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cad200/0x2f180c4effb0d82c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82be expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.139039:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d833 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82be expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166828.139050:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:2.0:1762166828.139052:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166828.139056:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac600, rc 0) 00000100:00100000:2.0:1762166828.139105:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:49318:x1847765440197120:12345-192.168.204.38@tcp:101:lseek_test.0 Request processed in 397us (566us total) trans 4294967549 rc 0/0 00000100:00100000:2.0:1762166828.139111:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2999 00000100:00100000:2.0:1762166828.140229:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166828.140289:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440197248 00000100:00100000:1.0:1762166828.140294:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440197248 00000100:00100000:1.0:1762166828.140326:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1199 00000100:00100000:1.0:1762166828.140331:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440197248:12345-192.168.204.38@tcp:23:lseek_test.0 00000100:00100000:1.0:1762166828.140407:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440197248:12345-192.168.204.38@tcp:23:lseek_test.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166828.140412:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1199 00000100:00100000:1.0:1762166828.148090:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.148170:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440197376 00000100:00100000:0.0:1762166828.148184:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440197376 00000100:00100000:0.0:1762166828.148266:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 298 00000100:00100000:0.0:1762166828.148274:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:44353:x1847765440197376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166828.148292:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 7 locks, starting at 0 00010000:00010000:0.0:1762166828.148335:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d825 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82b7 expref: 13 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.148362:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d817 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82a9 expref: 12 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.148377:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0d65e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->1073741823) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b821d expref: 11 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.148391:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ca33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f6f expref: 10 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.148407:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0bf5f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c12 expref: 9 pid: 8382 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1762166828.148441:0:9458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb size from disk: 0 -> 3381 00002000:00010000:0.0:1762166828.148444:0:9458:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb atime from disk: 0 -> 1762166772 00002000:00010000:0.0:1762166828.148446:0:9458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1762166828.148451:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0b786 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a05 expref: 8 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.148470:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf786b600/0x2f180c4effb0b9ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7ab4 expref: 7 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.148521:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166828.148585:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+6:44353:x1847765440197376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 312us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.148595:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 298 00000100:00100000:2.0:1762166828.149177:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166828.149213:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440197504 00000100:00100000:0.0:1762166828.149219:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440197504 00000100:00100000:0.0:1762166828.149258:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 299 00000100:00100000:0.0:1762166828.149264:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:49292:x1847765440197504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166828.149277:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1762166828.149296:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0400/0x2f180c4effb0d81e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82b0 expref: 11 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.149314:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0d657 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8216 expref: 10 pid: 8383 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1762166828.149326:0:9458:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1762166828.149335:0:9458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x48:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1762166828.149341:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0d11e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8080 expref: 9 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166828.149355:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effb0ca17 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f68 expref: 8 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.149369:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4a00/0x2f180c4effb0b9f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7abb expref: 7 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166828.149377:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166828.149401:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+6:49292:x1847765440197504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166828.149406:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 299 00000100:00100000:1.0:1762166828.818720:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166828.818742:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446875136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166828.818825:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166828.818858:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446875136 00000100:00100000:2.0:1762166828.818868:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446875136 00000100:00100000:2.0:1762166828.818930:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1762166828.818941:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765446875136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1762166828.818966:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 119012160 pending 0 free 3921379328 avail 3689545728 00000100:00100000:2.0:1762166828.819020:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765446875136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166828.819027:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1762166828.819068:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446875136:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1762166828.883157:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166829.906787:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1762166830.320496:0:33119:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 50b: mirror rsync handles sparseness == 05:47:10 (1762166830) 00000100:00100000:3.0:1762166830.347335:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166830.347418:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440197760 00000100:00100000:0.0:1762166830.347438:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440197760 00000100:00080000:3.0:1762166830.347514:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166830.347598:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3000 00000100:00100000:0.0:1762166830.347629:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:49896:x1847765440197760:12345-192.168.204.38@tcp:36:mkdir.0 00010000:00010000:0.0:1762166830.347714:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166830.347755:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0d1b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b809c expref: 16 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.347775:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166830.347780:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166830.347873:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.347887:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.347909:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349084:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349108:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166830.349113:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166830.349122:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166830.349200:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440197888 00000100:00100000:1.0:1762166830.349212:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440197888 00000100:00100000:1.0:1762166830.349262:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:1.0:1762166830.349271:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765440197888:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166830.349288:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166830.349347:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166830.349365:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765440197888:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166830.349373:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 72 00000100:00100000:1.0:1762166830.349430:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440198144 00000100:00100000:1.0:1762166830.349434:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440198144 00000100:00100000:3.0:1762166830.349470:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166830.349503:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00100000:1.0:1762166830.349516:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2417:x1847765440198144:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166830.349554:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2417:x1847765440198144:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166830.349562:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 288 00000100:00100000:1.0:1762166830.349574:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440198272 00000100:00100000:1.0:1762166830.349576:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440198272 00000100:00100000:1.0:1762166830.349600:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 289 00000100:00100000:1.0:1762166830.349607:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2417:x1847765440198272:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166830.349643:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440198016 00000100:00100000:1.0:1762166830.349648:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2417:x1847765440198272:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 40us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166830.349650:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440198016 00000100:00100000:1.0:1762166830.349655:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 289 00000100:00080000:1.0:1762166830.349705:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1762166830.349710:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166830.349714:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1762166830.349714:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349727:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349736:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166830.349757:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000953596f9 reply state 0000000045573216 transno 8589934617 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349770:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349779:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.349784:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166830.349789:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1762166830.349796:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x13:0x0]: returning size 4096 00010000:00010000:0.0:1762166830.349806:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349823:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349831:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166830.349838:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 448 00010000:00010000:0.0:1762166830.349841:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349850:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166830.349851:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+33:2417:x1847765440198016:12345-192.168.204.38@tcp:400:kworker.0 00010000:00010000:0.0:1762166830.349859:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349869:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349882:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166830.349884:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.349888:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349894:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d841 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166830.349907:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000953596f9 reply state 0000000045573216 transno 8589934617 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349915:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.349921:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c1754aa (ffff945bc4077500) 00010000:00010000:0.0:1762166830.349924:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166830.349926:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1762166830.349947:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+33:2417:x1847765440198016:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 99us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166830.349956:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 448 00000100:00100000:0.0:1762166830.350003:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:49896:x1847765440197760:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 2393us (2680us total) trans 8589934617 rc 0/0 00000100:00100000:0.0:1762166830.350013:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3000 00000100:00100000:1.0:1762166830.365067:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166830.365172:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440198400 00000100:00100000:0.0:1762166830.365187:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440198400 00000100:00100000:0.0:1762166830.365262:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3001 00000100:00100000:0.0:1762166830.365280:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:49902:x1847765440198400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166830.365315:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166830.365337:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d856 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82c5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.365416:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d85d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.365433:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d85d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.365446:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d85d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166830.365527:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166830.365532:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166830.365554:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d85d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.365581:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0d856 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82c5 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.365600:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0d85d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82c5 expref: 18 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.365610:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166830.365633:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166830.365638:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:0.0:1762166830.365715:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:49902:x1847765440198400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 441us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166830.365726:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3001 00000100:00100000:3.0:1762166830.367426:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166830.367503:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440198528 00000100:00100000:0.0:1762166830.367511:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440198528 00000100:00100000:0.0:1762166830.367553:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3002 00000100:00100000:0.0:1762166830.367560:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:49902:x1847765440198528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166830.367582:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166830.367598:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0d864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82cc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.367677:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367690:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367701:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367711:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367716:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367723:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367826:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d879 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367857:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d879 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367868:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d879 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166830.367911:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x13:0x0]: returning size 4096 00000004:00200000:0.0:1762166830.367915:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166830.367932:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d879 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367945:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367951:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367956:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367963:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367969:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166830.367976:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.367986:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368004:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166830.368009:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.368014:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368030:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0d86b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368045:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368052:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368057:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368063:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166830.368066:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368072:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368081:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c1754aa (ffff945bc4077500) 00010000:00010000:0.0:1762166830.368085:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.368088:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368092:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0d872 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.368112:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0d864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82cc expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.368122:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d879 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82cc expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.368138:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.368140:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1762166830.368143:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:0.0:1762166830.368191:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49902:x1847765440198528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 629us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166830.368206:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3002 00000100:00100000:3.0:1762166830.372325:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166830.372398:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440198656 00000100:00100000:0.0:1762166830.372413:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440198656 00000100:00100000:0.0:1762166830.372522:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3003 00000100:00100000:0.0:1762166830.372539:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49902:x1847765440198656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166830.372570:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166830.372599:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d880 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82d3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.372708:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372729:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372743:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372763:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372771:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372780:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372852:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372860:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372865:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372870:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372874:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166830.372878:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372883:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372893:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.372895:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.372899:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372903:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0d887 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372916:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372920:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372923:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372932:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166830.372935:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372938:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372942:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff945bc4077200) 00010000:00010000:0.0:1762166830.372944:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.372945:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372948:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0d88e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.372988:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d880 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82d3 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.372999:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.373001:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.373005:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0d880 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82d3 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.373015:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:0.0:1762166830.373114:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49902:x1847765440198656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 583us (803us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166830.373120:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3003 00000100:00100000:3.0:1762166830.374578:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166830.374650:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440198784 00000100:00100000:0.0:1762166830.374663:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440198784 00000100:00100000:0.0:1762166830.374728:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3004 00000100:00100000:0.0:1762166830.374743:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49902:x1847765440198784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166830.374766:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166830.374786:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0d895 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82da expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.374859:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374874:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374886:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374901:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374909:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374916:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374953:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374961:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374968:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374976:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.374990:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166830.374995:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375004:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375020:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.375024:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.375029:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375037:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ae00/0x2f180c4effb0d89c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375054:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375061:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375068:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375074:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166830.375078:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375085:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375095:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff945bc4077e00) 00010000:00010000:0.0:1762166830.375098:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.375108:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375115:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0d8a3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.375158:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0d895 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82da expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.375170:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.375173:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.375180:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0d895 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82da expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.375193:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:0.0:1762166830.375268:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49902:x1847765440198784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 531us (699us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166830.375290:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3004 00000100:00100000:3.0:1762166830.376886:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166830.376961:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440198912 00000100:00100000:0.0:1762166830.376973:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440198912 00000100:00100000:0.0:1762166830.377044:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3005 00000100:00100000:0.0:1762166830.377056:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:49902:x1847765440198912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166830.377080:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166830.377103:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d8aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82e1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.377193:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d8b1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.377208:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.377232:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166830.377288:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x13:0x0]: returning size 4096 00000004:00200000:0.0:1762166830.377292:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166830.377317:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.377348:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0d8aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82e1 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.377366:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82e1 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.377375:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.377378:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166830.377382:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a200, rc 0) 00000100:00100000:0.0:1762166830.377450:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49902:x1847765440198912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 396us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166830.377461:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3005 00000100:00100000:3.0:1762166830.380428:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166830.380539:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440199040 00000100:00100000:0.0:1762166830.380554:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440199040 00000100:00100000:0.0:1762166830.380637:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3006 00000100:00100000:0.0:1762166830.380652:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49902:x1847765440199040:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166830.380682:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166830.380707:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d8b8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82e8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.380798:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380829:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380844:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380865:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380872:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380879:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380932:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380942:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380949:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380956:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380962:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166830.380968:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.380976:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381005:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.381009:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.381015:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 3/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381023:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a400/0x2f180c4effb0d8bf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381040:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381046:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381052:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381059:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166830.381063:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381070:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381079:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff945bc4077900) 00010000:00010000:0.0:1762166830.381082:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.381085:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381092:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0d8c6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166830.381141:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d8b8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82e8 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.381160:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:0.0:1762166830.381163:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166830.381168:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d8b8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82e8 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166830.381181:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786be00, rc 0) 00000100:00100000:0.0:1762166830.381253:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49902:x1847765440199040:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 604us (835us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166830.381265:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3006 00000100:00100000:2.0:1762166830.383046:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166830.383239:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440199296 00000100:00100000:2.0:1762166830.383252:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440199296 00000100:00100000:2.0:1762166830.383316:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3007 00000100:00100000:2.0:1762166830.383332:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:49902:x1847765440199296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166830.383359:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166830.383363:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166830.383391:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0d8b1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82e1 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166830.383411:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:2.0:1762166830.383417:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166830.383433:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d8cd lrc: 2/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82ef expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166830.383604:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.383634:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.383659:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.383687:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 3/0,1 mode: --/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.383695:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.383704:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384368:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384381:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384393:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166830.384407:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 0 00010000:00010000:2.0:1762166830.384445:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384456:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384463:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384470:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384523:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cacc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166830.384537:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384547:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384567:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:2.0:1762166830.384571:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166830.384576:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 3/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384584:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0d8d4 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:2.0:1762166830.384612:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c17d9d3c reply state 00000000910a0769 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384637:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.384645:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff945cc7dfdc00) 00010000:00010000:2.0:1762166830.384648:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166830.384653:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166830.384699:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0d8cd lrc: 0/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166830.384727:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166830.384736:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945cc7dfde00) 00010000:00010000:2.0:1762166830.384740:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166830.384744:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad800, rc 0) 00000100:00100000:2.0:1762166830.384847:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:49902:x1847765440199296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1517us (1808us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1762166830.384869:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3007 00000100:00100000:2.0:1762166830.388115:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166830.388350:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440199552 00000100:00100000:3.0:1762166830.388373:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440199552 00000100:00100000:3.0:1762166830.389316:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3008 00000100:00100000:3.0:1762166830.389341:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:49902:x1847765440199552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166830.389388:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166830.389427:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0d8f0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82f6 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166830.389664:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166830.389684:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166830.389696:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166830.389771:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166830.389793:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 23 pid: 6496 timeout: 549 lvb_type: 0 00000100:00100000:3.0:1762166830.389828:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446875264:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166830.390014:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eaf540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166830.392063:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166830.392072:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446875264:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166830.392122:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166830.392133:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440199680 00000100:00100000:2.0:1762166830.392142:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440199680 00010000:00010000:2.0:1762166830.392197:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 24 pid: 6496 timeout: 549 lvb_type: 0 00000100:00100000:2.0:1762166830.392263:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 743 00000100:00100000:2.0:1762166830.392279:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440199680:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166830.392296:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166830.392305:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 24 pid: 6496 timeout: 549 lvb_type: 0 00010000:00010000:2.0:1762166830.392326:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 24 pid: 6496 timeout: 549 lvb_type: 0 00010000:00010000:2.0:1762166830.392360:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0d8e2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82ef expref: 24 pid: 6496 timeout: 549 lvb_type: 0 00010000:00010000:2.0:1762166830.392388:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945cc7dfde00) 00010000:00010000:2.0:1762166830.392394:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.392404:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.392412:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.392454:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166830.392559:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440199680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 282us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166830.392573:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 743 00010000:00010000:1.0:1762166830.392735:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.392745:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166830.392770:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 0 00000004:00080000:1.0:1762166830.392968:0:12357:0:(osp_internal.h:565:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x4f:0x0], count =19 00000004:00080000:1.0:1762166830.392978:0:12357:0:(osp_object.c:1632:osp_create()) Writing gap [0x280000401:0x4f:0x0]+19 in llog 00000004:00080000:1.0:1762166830.393031:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x62:0x0], index 0: 0 00000004:00080000:1.0:1762166830.393036:0:12357:0:(osp_internal.h:565:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x49:0x0], count =25 00000004:00080000:1.0:1762166830.393039:0:12357:0:(osp_object.c:1632:osp_create()) Writing gap [0x2c0000401:0x49:0x0]+25 in llog 00000004:00080000:1.0:1762166830.393043:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x62:0x0], index 1: 0 00010000:00010000:1.0:1762166830.393158:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.393167:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.393173:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.393179:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166830.393183:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.393196:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.393211:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945cc7dfde00) 00010000:00010000:1.0:1762166830.393215:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166830.393218:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.393222:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0d8f7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.393270:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0d8f0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82f6 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.393280:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:1.0:1762166830.393282:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166830.393286:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0d8f0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82f6 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.393295:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28600, rc 0) 00000100:00100000:1.0:1762166830.393331:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:49902:x1847765440199552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 4000us (5235us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1762166830.393339:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3008 00000100:00100000:2.0:1762166830.394836:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166830.394898:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440199936 00000100:00100000:3.0:1762166830.394914:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440199936 00000100:00100000:3.0:1762166830.394992:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 867 00000100:00100000:3.0:1762166830.395004:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:49902:x1847765440199936:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166830.395411:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:49902:x1847765440199936:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 409us (579us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1762166830.395421:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 867 00000100:00100000:2.0:1762166830.396932:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166830.396991:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440200192 00000100:00100000:3.0:1762166830.397004:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440200192 00000100:00100000:3.0:1762166830.397060:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 868 00000100:00100000:3.0:1762166830.397070:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:49902:x1847765440200192:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166830.397284:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:49902:x1847765440200192:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 215us (372us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1762166830.397294:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 868 00000100:00100000:2.0:1762166830.403062:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166830.403111:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440200448 00000100:00100000:1.0:1762166830.403123:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440200448 00000100:00100000:1.0:1762166830.403182:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3009 00000100:00100000:1.0:1762166830.403195:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:49905:x1847765440200448:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166830.403234:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166830.403267:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0d905 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b82fd expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.403423:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403437:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403447:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403457:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403463:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403469:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403550:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0d91a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403557:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0d91a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403563:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0d91a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166830.403571:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 0 00010000:00010000:1.0:1762166830.403657:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403664:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403675:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403681:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166830.403684:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403691:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403702:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:1.0:1762166830.403714:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166830.403719:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403724:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410600/0x2f180c4effb0d90c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403735:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403741:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403745:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403749:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166830.403751:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403755:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403766:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff945cc7dfdc00) 00010000:00010000:1.0:1762166830.403768:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166830.403770:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403775:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d913 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.403806:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0d905 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82fd expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.403816:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0d91a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82fd expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.403822:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:1.0:1762166830.403824:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166830.403826:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411e00, rc 0) 00000100:00100000:1.0:1762166830.403878:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:49905:x1847765440200448:12345-192.168.204.38@tcp:101:dd.0 Request processed in 687us (827us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1762166830.403887:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3009 00000100:00100000:2.0:1762166830.405542:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166830.405613:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440200576 00000100:00100000:1.0:1762166830.405631:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440200576 00000100:00100000:1.0:1762166830.405703:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3010 00000100:00100000:1.0:1762166830.405719:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:49905:x1847765440200576:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166830.405741:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166830.405764:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0d928 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8304 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.405838:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0d92f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.405853:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0d92f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.405863:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0d92f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.405977:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0d928 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8304 expref: 28 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.405993:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0d92f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8304 expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.406002:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:1.0:1762166830.406006:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166830.406009:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410200, rc 0) 00000100:00100000:1.0:1762166830.406059:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:49905:x1847765440200576:12345-192.168.204.38@tcp:101:dd.0 Request processed in 348us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166830.406065:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3010 00000100:00100000:1.0:1762166830.407273:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166830.407357:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440200832 00000100:00100000:2.0:1762166830.407365:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440200832 00000100:00100000:2.0:1762166830.407407:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3011 00000100:00100000:2.0:1762166830.407422:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:49905:x1847765440200832:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:2.0:1762166830.407464:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166830.407519:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0d91a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82fd expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166830.407536:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:2.0:1762166830.407540:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166830.407732:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.407746:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.407754:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000001:00080000:2.0:1762166830.407824:0:12357:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934623 00000004:00010000:2.0:1762166830.407851:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000237d0b6c reply state 000000006645be41 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.407875:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.407882:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:2.0:1762166830.407885:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166830.407888:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166830.407978:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:49905:x1847765440200832:12345-192.168.204.38@tcp:36:dd.0 Request processed in 562us (713us total) trans 8589934624 rc 0/0 00000100:00100000:2.0:1762166830.407985:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3011 00000020:00080000:2.0:1762166830.407991:0:12357:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166830.409454:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166830.409536:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440200960 00000100:00100000:1.0:1762166830.409544:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440200960 00000100:00100000:1.0:1762166830.409583:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3012 00000100:00100000:1.0:1762166830.409592:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:49905:x1847765440200960:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166830.409609:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166830.409632:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d93d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b830b expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.409680:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d93d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b830b expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.409692:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d93d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b830b expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.409709:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:1.0:1762166830.409712:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166830.409715:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411000, rc 0) 00000100:00100000:1.0:1762166830.409755:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+30:49905:x1847765440200960:12345-192.168.204.38@tcp:101:dd.0 Request processed in 164us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166830.409763:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3012 00000100:00100000:3.0:1762166830.410998:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166830.411060:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440201216 00000100:00100000:1.0:1762166830.411067:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440201216 00000100:00100000:1.0:1762166830.411101:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3013 00000100:00100000:1.0:1762166830.411113:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+30:49905:x1847765440201216:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166830.411125:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166830.411128:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166830.411146:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d93d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b830b expref: 30 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.411160:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:1.0:1762166830.411164:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166830.411172:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0d944 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8312 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.411212:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d94b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.411231:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d94b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.411240:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d94b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000040:00080000:1.0:1762166830.411449:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 88 off8408 00000004:00080000:1.0:1762166830.411460:0:12357:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449559981414ns, next at 447432031154ns, rc = 0 00000040:00080000:1.0:1762166830.411517:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1762166830.411524:0:12357:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 449560046109ns, next at 0ns, rc = 0 00000004:00080000:0.0:1762166830.411584:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000004:00080000:0.0:1762166830.411637:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000100:00100000:1.0:1762166830.411650:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446875392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166830.411672:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762166830.411686:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446875520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166830.411702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166830.411729:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166830.411731:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446875392 00000100:00100000:0.0:1762166830.411737:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446875392 00000100:00100000:2.0:1762166830.411781:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446875520 00000100:00100000:2.0:1762166830.411787:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446875520 00000100:00080000:1.0:1762166830.411796:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166830.411801:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1762166830.411813:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446875392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166830.411827:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1762166830.411837:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765446875520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166830.411957:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446875520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (229us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166830.411966:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1762166830.411973:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446875392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (272us total) trans 0 rc -22/-22 00000100:00100000:0.0:1762166830.411983:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000004:00080000:2.0:1762166830.412064:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b5f80, transno 0 00000100:00100000:2.0:1762166830.412068:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869390 gen 2 00000004:00080000:2.0:1762166830.412085:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b5f80/1, rc -22, transno 0 00000100:00100000:2.0:1762166830.412101:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446875520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762166830.412127:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b6300, transno 0 00000004:00080000:2.0:1762166830.412131:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b6300/1, rc -22, transno 0 00000100:00100000:2.0:1762166830.412142:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446875392:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1762166830.413049:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:3.0:1762166830.413058:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:3.0:1762166830.413079:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:2.0:1762166830.413082:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413093:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413113:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413121:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00000001:00080000:3.0:1762166830.413126:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00010000:00010000:2.0:1762166830.413127:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413140:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413156:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c1754aa (ffff945bc4077500) 00000100:00100000:0.0:1762166830.413156:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1762166830.413163:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166830.413169:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166830.413174:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446875648:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166830.413179:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0d848 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4c1754aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166830.413193:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446875776:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762166830.413204:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413213:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166830.413218:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166830.413221:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d94b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8312 expref: 23 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166830.413229:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166830.413237:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:2.0:1762166830.413239:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166830.413243:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166830.413247:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166830.413248:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166830.413258:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166830.413262:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0d944 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8312 expref: 23 pid: 12357 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166830.413278:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446875648 00000100:00100000:0.0:1762166830.413284:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446875648 00010000:00010000:2.0:1762166830.413290:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:1.0:1762166830.413292:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0d94b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x14:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8312 expref: 22 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166830.413295:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166830.413296:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446875776 00010000:00010000:2.0:1762166830.413301:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166830.413303:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446875776 00010000:00010000:2.0:1762166830.413312:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0200/0x2f180c4effb0d84f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166830.413321:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1762166830.413331:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446875648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166830.413345:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00010000:00010000:1.0:1762166830.413353:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:2.0:1762166830.413355:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166830.413357:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446875776:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762166830.413360:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166830.413365:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410e00, rc 0) 00010000:00010000:2.0:1762166830.413371:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413379:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413384:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166830.413387:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413394:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413403:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0xe1e61496 (ffff945cc7dfdc00) 00010000:00010000:2.0:1762166830.413405:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166830.413408:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166830.413414:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac400/0x2f180c4effb0d8db lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x13:0x0].0xe1e61496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166830.413423:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:49905:x1847765440201216:12345-192.168.204.38@tcp:101:dd.0 Request processed in 2313us (2427us total) trans 8589934625 rc 0/0 00000100:00100000:1.0:1762166830.413432:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3013 00010000:00010000:2.0:1762166830.413434:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.413450:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.413457:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166830.413463:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3caca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166830.413467:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166830.413472:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446875648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (255us total) trans 17179869409 rc 0/0 00010000:00010000:2.0:1762166830.413508:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00000100:00100000:3.0:1762166830.413520:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446875776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (276us total) trans 21474836738 rc 0/0 00010000:00010000:2.0:1762166830.413524:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00000004:00080000:1.0:1762166830.413530:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b7b80/2, rc 0, transno 17179869409 00010000:00010000:2.0:1762166830.413534:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166830.413538:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1762166830.413539:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446875648:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166830.413541:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166830.413549:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00010000:00010000:2.0:1762166830.413555:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0d936 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00080000:3.0:1762166830.413566:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166830.413595:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836712 gen 2 00000004:00080000:3.0:1762166830.413608:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5807480, transno 21474836712 00000100:00100000:3.0:1762166830.413638:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf783aa00 x1847765446875776/t21474836738(21474836738) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166846 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166830.413647:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783aa00/2, rc 0, transno 21474836738 00000100:00100000:3.0:1762166830.413652:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446875776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166830.422683:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166830.422842:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440201344 00000100:00100000:1.0:1762166830.422866:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440201344 00000100:00100000:1.0:1762166830.422948:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3014 00000100:00100000:1.0:1762166830.422961:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:49905:x1847765440201344:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166830.422992:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166830.423014:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0d952 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8319 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.423123:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d959 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.423138:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d959 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.423151:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d959 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166830.423185:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x14:0x0]: returning size 1045506 00000004:00200000:1.0:1762166830.423190:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166830.423233:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d959 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166830.423258:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0d952 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8319 expref: 21 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.423275:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0d959 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8319 expref: 20 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166830.423283:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x14:0x0].0x0 (ffff945bc4180800) 00010000:00010000:1.0:1762166830.423286:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166830.423290:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411000, rc 0) 00000100:00100000:1.0:1762166830.423360:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:49905:x1847765440201344:12345-192.168.204.38@tcp:101:dd.0 Request processed in 401us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166830.423367:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3014 00000100:00100000:2.0:1762166830.425214:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166830.425328:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440201472 00000100:00100000:0.0:1762166830.425338:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440201472 00000100:00100000:0.0:1762166830.425408:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1204 00000100:00100000:0.0:1762166830.425424:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+6:2418:x1847765440201472:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:0.0:1762166830.425441:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166830.425458:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d960 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8320 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166830.425504:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166830.425522:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166830.425524:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166830.425534:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d960 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8320 expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166830.425551:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0d960 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8320 expref: 7 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166830.425563:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786be00, rc 0) 00000100:00100000:0.0:1762166830.425617:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+7:2418:x1847765440201472:12345-192.168.204.38@tcp:101:dd.0 Request processed in 199us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166830.425634:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1204 00000100:00100000:3.0:1762166830.427687:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166830.427793:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440201728 00000100:00100000:2.0:1762166830.427804:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440201728 00000100:00100000:2.0:1762166830.427861:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 869 00000100:00100000:2.0:1762166830.427870:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:49905:x1847765440201728:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:2.0:1762166830.428096:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:49905:x1847765440201728:12345-192.168.204.38@tcp:35:dd.0 Request processed in 226us (423us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1762166830.428104:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 869 00010000:00010000:2.0:1762166830.930711:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762166830.989659:0:33167:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_50b: @@@@@@ FAIL: cannot write data at 1M boundary 00000100:00100000:3.0:1762166831.378838:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446875904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1762166831.378925:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166831.378972:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446875904 00000100:00100000:0.0:1762166831.378982:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446875904 00000100:00080000:3.0:1762166831.379022:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166831.379051:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1762166831.379064:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446875904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1762166831.379092:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 84392768 pending 0 free 3921342464 avail 3689820160 00000100:00100000:0.0:1762166831.379145:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446875904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166831.379153:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1762166831.379190:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446875904:0@lo:13:osp-pre-1-1.0 Debug log: 39299 lines, 39299 kept, 0 dropped, 0 bad.